Apr 15 10:01:15 devstack cinder-volume[73415]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 10:01:15 devstack cinder-volume[73415]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:01:15 devstack cinder-volume[73415]: we strongly recommend against using it for new projects. Apr 15 10:01:15 devstack cinder-volume[73415]: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:01:15 devstack cinder-volume[73415]: framework. For more detail see Apr 15 10:01:15 devstack cinder-volume[73415]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:01:15 devstack cinder-volume[73415]: import eventlet # noqa Apr 15 10:01:16 devstack cinder-volume[73415]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:01:16 devstack cinder-volume[73415]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:01:16 devstack cinder-volume[73415]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:01:17 devstack cinder-volume[73415]: INFO dbcounter [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Registered counter for database cinder Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_db.sqlalchemy.engines [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73415) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG dbcounter [-] [73415] Writer thread running {{(pid=73415) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:01:17 devstack cinder-volume[73415]: INFO cinder.rpc [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 10:01:17 devstack cinder-volume[73415]: INFO cinder.rpc [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_db.sqlalchemy.engines [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73415) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:01:17 devstack cinder-volume[73415]: INFO cinder.volume.manager [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Determined volume DB was empty at startup. Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG cinder.volume.manager [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73415) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 10:01:17 devstack cinder-volume[73415]: INFO cinder.volume.manager [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 10:01:17 devstack cinder-volume[73415]: WARNING stevedore.named [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 10:01:17 devstack cinder-volume[73415]: WARNING castellan.key_manager [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:01:17 devstack cinder-volume[73415]: WARNING cinder.keymgr.conf_key_mgr [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG cinder.volume.drivers.lvm [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73415) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_concurrency.processutils [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73415) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_concurrency.processutils [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] CMD "cinder-rtstool verify" returned: 0 in 0.287s {{(pid=73415) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_db.sqlalchemy.engines [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73415) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:01:17 devstack cinder-volume[73415]: INFO cinder.rpc [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 15 10:01:17 devstack cinder-volume[73415]: INFO cinder.rpc [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 15 10:01:17 devstack cinder-volume[73415]: WARNING stevedore.named [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 10:01:17 devstack cinder-volume[73415]: WARNING castellan.key_manager [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:01:17 devstack cinder-volume[73415]: INFO cinder.volume.manager [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_db.sqlalchemy.engines [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73415) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:01:17 devstack cinder-volume[73415]: INFO oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Starting 1 workers Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Started child 73523 {{(pid=73415) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Full set of CONF: {{(pid=73415) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] ******************************************************************************** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Configuration options gathered from: {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] ================================================================================ {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] allow_availability_zone_fallback = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] allow_compression_on_image_upload = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] allowed_direct_url_schemes = [] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] api_rate_limit = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] auth_strategy = keystone {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] az_cache_duration = 3600 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_availability_zone = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_host = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_name = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_stats_polling_interval = 60 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backup_api_class = cinder.backup.api.API {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backup_name_template = backup-%s {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backup_use_same_host = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backup_use_temp_snapshot = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] chap_password = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] chap_username = {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cinder_internal_tenant_project_id = a798c4ef8a074acca83eba7b053c5137 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cinder_internal_tenant_user_id = f37589c3fc594951873419d6fd25cec9 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cloned_volume_same_az = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cluster = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73523]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] compression_format = gzip {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] compute_api_class = cinder.compute.nova.API {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] config_dir = [] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] config_source = [] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] control_exchange = openstack {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] debug = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] default_availability_zone = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] default_group_type = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] default_volume_type = lvmdriver-1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] disk_geometry = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] driver_client_cert = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] driver_client_cert_key = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] driver_data_namespace = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] driver_ssl_cert_path = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] driver_ssl_cert_verify = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] driver_use_ssl = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] enable_force_upload = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] enable_new_services = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] enable_unsupported_driver = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] enabled_backends = ['lvmdriver-1'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] enforce_multipath_for_image_xfer = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] filter_function = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance_api_insecure = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance_api_servers = ['http://192.168.122.152/image'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance_api_ssl_compression = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance_ca_certificates_file = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance_catalog_info = image:glance:publicURL {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance_certfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance_keyfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance_num_retries = 3 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance_request_timeout = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:17 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] goodness_function = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] graceful_shutdown_timeout = 5 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] group_api_class = cinder.group.api.API {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] host = devstack {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] image_compress_on_upload = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] image_conversion_address_space_limit = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] image_conversion_cpu_limit = 60 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] image_conversion_disable = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] image_upload_use_cinder_backend = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] image_upload_use_internal_tenant = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] image_volume_cache_enabled = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] image_volume_cache_max_count = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] image_volume_cache_max_size_gb = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] init_host_max_objects_retrieval = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] instance_format = [instance: %(uuid)s] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] iscsi_target_flags = {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] iscsi_write_cache = on {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] iser_helper = tgtadm {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] iser_ip_address = 192.168.122.152 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] iser_port = 3260 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] log_color = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] log_config_append = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] log_dir = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] log_file = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] log_options = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] log_rotate_interval = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] log_rotate_interval_type = days {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] log_rotation_type = none {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73523]: INFO cinder.volume.manager [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 15 10:01:18 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] max_age = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] max_logfile_count = 30 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] max_logfile_size_mb = 200 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] max_over_subscription_ratio = 20.0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] message_reap_interval = 86400 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] message_ttl = 2592000 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] migration_create_volume_timeout_secs = 300 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] monkey_patch = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] monkey_patch_modules = [] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] my_ip = 192.168.122.152 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] no_snapshot_gb_quota = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] num_iser_scan_tries = 3 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] num_shell_tries = 3 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] num_volume_device_scan_tries = 3 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] nvmeof_conn_info_version = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] nvmet_ns_id = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] nvmet_port_id = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] osapi_max_limit = 1000 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] osapi_volume_ext_list = [] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] osapi_volume_listen = 0.0.0.0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] osapi_volume_listen_port = 8776 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] osapi_volume_use_ssl = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] osapi_volume_workers = 2 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] per_volume_size_limit = -1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] periodic_fuzzy_delay = 60 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] periodic_interval = 60 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] project_id_regex = [0-9a-f\-]+ {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] public_endpoint = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] publish_errors = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] quota_backup_gigabytes = 1000 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] quota_backups = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] quota_gigabytes = 1000 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] quota_groups = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] quota_snapshots = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] quota_volumes = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] rate_limit_burst = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] rate_limit_except_level = CRITICAL {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] rate_limit_interval = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] reinit_driver_count = 3 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] replication_device = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] report_discard_supported = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] report_interval = 120 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] reservation_clean_interval = 86400 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] reservation_expire = 86400 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] reserved_image_namespaces = [] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] reserved_percentage = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] rpc_response_timeout = 120 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] run_external_periodic_tasks = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] scst_target_driver = iscsi {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] scst_target_iqn_name = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] service_down_time = 720 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] shell_completion = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] snapshot_name_template = snapshot-%s {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] snapshot_same_host = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] split_loggers = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] state_path = /opt/stack/data/cinder {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] storage_availability_zone = nova {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] storage_protocol = iSCSI {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] syslog_log_facility = LOG_USER {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] target_helper = lioadm {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] target_ip_address = 192.168.122.152 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] target_port = 3260 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] target_protocol = iscsi {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] target_secondary_ip_addresses = [] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] trace_flags = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] transfer_api_class = cinder.transfer.api.API {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] transport_url = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] until_refresh = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] use_chap_auth = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] use_default_quota_class = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] use_journal = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] use_json = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] use_multipath_for_image_xfer = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] use_stderr = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] use_syslog = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] verify_glance_signatures = enabled {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] volume_api_class = cinder.volume.api.API {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] volume_backend_name = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] volume_clear = zero {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] volume_clear_ionice = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] volume_clear_size = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] volume_copy_bps_limit = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] volume_dd_blocksize = 1M {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] volume_name_template = volume-%s {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] volume_service_inithost_offload = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] volume_usage_audit_period = month {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] zoning_mode = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:18 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_concurrency.disable_process_locking = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.admin_password = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.admin_token = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.admin_user = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.auth_admin_prefix = {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.auth_port = 35357 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.auth_protocol = https {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.auth_section = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.auth_type = password {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.auth_uri = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.auth_version = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.cache = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.certfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.delay_auth_decision = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.http_connect_timeout = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.identity_uri = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.include_service_catalog = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.insecure = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.interface = public {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.keyfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_password = {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcache_username = {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.region_name = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.service_token_roles_required = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.service_type = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.token_cache_time = 300 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.152/identity {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.backend = dogpile.cache.null {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.backend_argument = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.backend_expiration_time = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.config_prefix = cache.oslo {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.debug_cache_backend = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.enable_retry_client = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.enable_socket_keepalive = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.enabled = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.enforce_fips_mode = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack sudo[73527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.expiration_time = 600 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack sudo[73527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.hashclient_retry_attempts = 2 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.memcache_dead_retry = 300 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.memcache_pool_maxsize = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.memcache_sasl_enabled = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.password = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.proxies = [] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.redis_db = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.redis_sentinel_service_name = mymaster {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.redis_server = localhost:6379 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.retry_attempts = 2 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.retry_delay = 0.0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.socket_keepalive_count = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.socket_keepalive_idle = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.socket_keepalive_interval = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.socket_timeout = 1.0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.tls_allowed_ciphers = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.tls_cafile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.tls_certfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.tls_enabled = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.tls_keyfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cache.username = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] coordination.backend_url = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.asyncio_connection = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.asyncio_slave_connection = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.backend = sqlalchemy {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.connection = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.connection_debug = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.connection_parameters = {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.connection_recycle_time = 3600 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.connection_trace = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.db_inc_retry_interval = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.db_max_retries = 20 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.db_max_retry_interval = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.db_retry_interval = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.max_overflow = 50 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.max_pool_size = 5 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.max_retries = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.mysql_wsrep_sync_wait = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.pool_timeout = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.retry_interval = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.slave_connection = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.sqlite_synchronous = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.synchronous_reader = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] database.use_db_reconnect = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler.connection_string = messaging:// {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler.enabled = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler.es_doc_type = notification {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler.es_scroll_size = 10000 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler.es_scroll_time = 2m {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler.filter_error_trace = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler.hmac_keys = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler.sentinel_service_name = mymaster {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler.socket_timeout = 0.1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler.trace_requests = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler.trace_sqlalchemy = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler_jaeger.process_tags = {} {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler_jaeger.service_name_prefix = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] profiler_otlp.service_name_prefix = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_policy.enforce_new_defaults = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: WARNING oslo_config.cfg [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_policy.enforce_scope = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_policy.policy_default_rule = default {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_policy.policy_file = policy.yaml {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_policy.remote_timeout = 60.0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] privsep_osbrick.group = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] privsep_osbrick.helper_command = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] privsep_osbrick.user = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cinder_sys_admin.group = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cinder_sys_admin.helper_command = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] cinder_sys_admin.user = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] service_user.auth_section = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] service_user.auth_type = password {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] service_user.cafile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] service_user.certfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] service_user.collect_timing = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] service_user.insecure = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] service_user.keyfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] service_user.send_service_user_token = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] service_user.split_loggers = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] service_user.timeout = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance.auth_section = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance.auth_type = password {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance.certfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance.collect_timing = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance.insecure = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance.keyfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance.region_name = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance.split_loggers = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] glance.timeout = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.backend_availability_zone = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.chap_password = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.chap_username = {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.disk_geometry = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.driver_client_cert = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.driver_client_cert_key = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.driver_data_namespace = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.driver_use_ssl = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.enable_unsupported_driver = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.extra_capabilities = {} {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.filter_function = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.goodness_function = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.iscsi_target_flags = {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.iscsi_write_cache = on {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.iser_helper = tgtadm {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.iser_ip_address = 192.168.122.152 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.iser_port = 3260 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.lvm_mirrors = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.lvm_share_target = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.lvm_type = auto {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.num_shell_tries = 3 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.nvmet_port_id = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.replication_device = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.report_discard_supported = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.reserved_percentage = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.scst_target_driver = iscsi {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.scst_target_iqn_name = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.storage_protocol = iSCSI {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.target_helper = tgtadm {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.target_ip_address = 192.168.122.152 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.target_port = 3260 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.target_protocol = iscsi {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.trace_flags = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.unique_fqdn_network = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.use_chap_auth = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.volume_backend_name = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.volume_clear = zero {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.volume_clear_ionice = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.volume_clear_size = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.volume_group = cinder-volumes {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_reports.file_event_handler = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_reports.log_dir = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.backend_availability_zone = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.backend_host = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.chap_password = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.chap_username = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.chiscsi_conf = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.disk_geometry = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.driver_client_cert = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.driver_data_namespace = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.driver_use_ssl = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.extra_capabilities = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.filter_function = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.goodness_function = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.iser_helper = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.iser_ip_address = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.iser_port = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.iser_target_prefix = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.lvm_conf_file = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.lvm_mirrors = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.lvm_share_target = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.lvm_type = auto {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.num_shell_tries = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.nvmet_port_id = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.replication_device = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.report_discard_supported = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.reserved_percentage = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.scst_target_driver = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.storage_protocol = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.target_helper = lioadm {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.target_ip_address = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.target_port = 3260 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.target_protocol = iscsi {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.trace_flags = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.use_chap_auth = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.volume_clear = zero {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.volume_clear_size = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] lvmdriver-1.volumes_dir = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.ssl = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.ssl_version = {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_notifications.driver = [] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_notifications.retry = -1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] oslo_messaging_notifications.transport_url = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] key_manager.fixed_key = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.barbican_api_version = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.barbican_endpoint = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.barbican_endpoint_type = public {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.barbican_region_name = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.cafile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.certfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.collect_timing = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.insecure = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.keyfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.number_of_retries = 60 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.retry_delay = 1 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.send_service_user_token = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.split_loggers = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.timeout = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.verify_ssl = True {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican.verify_ssl_path = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican_service_user.auth_section = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican_service_user.auth_type = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican_service_user.cafile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican_service_user.certfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican_service_user.collect_timing = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican_service_user.insecure = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican_service_user.keyfile = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican_service_user.split_loggers = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] barbican_service_user.timeout = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] vault.approle_role_id = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] vault.approle_secret_id = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] vault.kv_mountpoint = secret {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] vault.kv_path = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] vault.kv_version = 2 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] vault.namespace = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] vault.root_token_id = **** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] vault.ssl_ca_crt_file = None {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] vault.timeout = 60.0 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] vault.use_ssl = False {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:18 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] ******************************************************************************** {{(pid=73415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 10:01:18 devstack sudo[73527]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:18 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:18 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:18 devstack sudo[73531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:18 devstack sudo[73531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:19 devstack sudo[73531]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:19 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.592s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:19 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:01:19 devstack cinder-volume[73523]: INFO cinder.brick.local_dev.lvm [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 15 10:01:19 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:19 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:19 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:19 devstack sudo[73677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:01:19 devstack sudo[73677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:19 devstack sudo[73677]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:19 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.534s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:19 devstack cinder-volume[73523]: DEBUG cinder.brick.local_dev.lvm [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73523) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 15 10:01:19 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:19 devstack sudo[73890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:19 devstack sudo[73890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:20 devstack sudo[73890]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:20 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.005s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:20 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:20 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:20 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:20 devstack sudo[74131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:20 devstack sudo[74131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:21 devstack sudo[74131]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:21 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.581s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:21 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:21 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:21 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:21 devstack sudo[74220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 15 10:01:21 devstack sudo[74220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:21 devstack sudo[74220]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:21 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.507s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:21 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:21 devstack sudo[74226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:01:21 devstack sudo[74226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:22 devstack sudo[74226]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:22 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:22 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:22 devstack sudo[74229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:01:22 devstack sudo[74229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:22 devstack sudo[74229]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:22 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:22 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:22 devstack sudo[74234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:22 devstack sudo[74234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:23 devstack sudo[74234]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:23 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:23 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:23 devstack sudo[74238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:23 devstack sudo[74238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:23 devstack sudo[74238]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:23 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.479s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:23 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:23 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:23 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:23 devstack sudo[74253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:23 devstack sudo[74253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:24 devstack sudo[74253]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:24 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.427s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:24 devstack cinder-volume[73523]: INFO cinder.volume.drivers.lvm [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 15 10:01:24 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:24 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:24 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:24 devstack sudo[74257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:24 devstack sudo[74257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:24 devstack sudo[74257]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:24 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:24 devstack cinder-volume[73523]: DEBUG cinder.volume.drivers.lvm [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Updating volume stats {{(pid=73523) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:01:24 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:24 devstack sudo[74265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:01:24 devstack sudo[74265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:25 devstack sudo[74265]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:25 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:25 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:25 devstack sudo[74269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:25 devstack sudo[74269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:25 devstack sudo[74269]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:25 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:25 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:25 devstack sudo[74274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:25 devstack sudo[74274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:26 devstack sudo[74274]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:26 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:26 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:26 devstack sudo[74386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:26 devstack sudo[74386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:26 devstack sudo[74386]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:26 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.511s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:26 devstack cinder-volume[73523]: INFO cinder.volume.driver [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 10:01:26 devstack cinder-volume[73523]: DEBUG cinder.volume.driver [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73523) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 10:01:26 devstack cinder-volume[73523]: DEBUG oslo_db.sqlalchemy.engines [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:01:26 devstack cinder-volume[73523]: DEBUG dbcounter [-] [73523] Writer thread running {{(pid=73523) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:01:26 devstack cinder-volume[73523]: DEBUG cinder.db.sqlalchemy.api [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Building query based on filter {{(pid=73523) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 10:01:26 devstack cinder-volume[73523]: DEBUG cinder.image.image_utils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73523) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 10:01:26 devstack cinder-volume[73523]: INFO cinder.keymgr.migration [None req-842b76fd-4508-4771-be1c-4655541191c4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 10:01:26 devstack cinder-volume[73523]: DEBUG cinder.volume.drivers.lvm [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Updating volume stats {{(pid=73523) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:01:26 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:26 devstack sudo[74525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:01:26 devstack sudo[74525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:27 devstack sudo[74525]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:27 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:27 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:27 devstack sudo[74533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:27 devstack sudo[74533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:27 devstack sudo[74533]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:27 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:27 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:27 devstack sudo[74537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:27 devstack sudo[74537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:27 devstack cinder-volume[73415]: DEBUG dbcounter [-] [73415] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73415) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:01:28 devstack sudo[74537]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:28 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:28 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:28 devstack sudo[74544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:28 devstack sudo[74544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:28 devstack sudo[74544]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:28 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:28 devstack cinder-volume[73523]: DEBUG cinder.manager [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Notifying Schedulers of capabilities ... {{(pid=73523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:01:28 devstack cinder-volume[73523]: INFO cinder.volume.manager [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Driver initialization completed successfully. Apr 15 10:01:28 devstack cinder-volume[73523]: INFO cinder.manager [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Initiating service 2 cleanup Apr 15 10:01:28 devstack cinder-volume[73523]: INFO cinder.manager [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Service 2 cleanup completed. Apr 15 10:01:28 devstack cinder-volume[73523]: DEBUG cinder.service [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Creating RPC server for service cinder-volume {{(pid=73523) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 10:01:28 devstack cinder-volume[73523]: DEBUG cinder.service [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73523) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 10:01:28 devstack cinder-volume[73523]: INFO cinder.volume.manager [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 15 10:01:28 devstack cinder-volume[73523]: DEBUG cinder.volume.drivers.lvm [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Updating volume stats {{(pid=73523) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:01:28 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:28 devstack sudo[74548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:01:28 devstack sudo[74548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:29 devstack sudo[74548]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:29 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:29 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:29 devstack sudo[74551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:29 devstack sudo[74551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:29 devstack sudo[74551]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:29 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:29 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:29 devstack sudo[74557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:29 devstack sudo[74557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:30 devstack sudo[74557]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:30 devstack sudo[74561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:30 devstack sudo[74561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:30 devstack sudo[74561]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:31 devstack cinder-volume[73523]: INFO cinder.volume.manager [None req-bc779ad5-71df-4ff4-8bce-d7201f137423 None None] Driver post RPC initialization completed successfully. Apr 15 10:01:38 devstack cinder-volume[73523]: DEBUG dbcounter [-] [73523] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73523) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:01:40 devstack cinder-volume[73523]: DEBUG dbcounter [-] [73523] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73523) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:02:29 devstack cinder-volume[73523]: DEBUG oslo_service.periodic_task [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73523) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:02:29 devstack cinder-volume[73523]: DEBUG cinder.volume.drivers.lvm [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Updating volume stats {{(pid=73523) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:02:29 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:02:29 devstack sudo[79341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:02:29 devstack sudo[79341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:02:30 devstack sudo[79341]: pam_unix(sudo:session): session closed for user root Apr 15 10:02:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:02:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:02:30 devstack sudo[79349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:02:30 devstack sudo[79349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:02:30 devstack sudo[79349]: pam_unix(sudo:session): session closed for user root Apr 15 10:02:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:02:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:02:30 devstack sudo[79352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:02:30 devstack sudo[79352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:02:30 devstack sudo[79352]: pam_unix(sudo:session): session closed for user root Apr 15 10:02:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.457s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:02:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:02:30 devstack sudo[79357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:02:30 devstack sudo[79357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:02:31 devstack sudo[79357]: pam_unix(sudo:session): session closed for user root Apr 15 10:02:31 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:02:31 devstack cinder-volume[73523]: DEBUG cinder.manager [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Notifying Schedulers of capabilities ... {{(pid=73523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:03:29 devstack cinder-volume[73523]: DEBUG oslo_service.periodic_task [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73523) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:03:29 devstack cinder-volume[73523]: DEBUG cinder.volume.drivers.lvm [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Updating volume stats {{(pid=73523) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:03:29 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:29 devstack sudo[80305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:03:29 devstack sudo[80305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:03:30 devstack sudo[80305]: pam_unix(sudo:session): session closed for user root Apr 15 10:03:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:30 devstack sudo[80369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:03:30 devstack sudo[80369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:03:30 devstack sudo[80369]: pam_unix(sudo:session): session closed for user root Apr 15 10:03:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:30 devstack sudo[80386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:03:30 devstack sudo[80386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:03:30 devstack sudo[80386]: pam_unix(sudo:session): session closed for user root Apr 15 10:03:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.475s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:31 devstack sudo[80401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:03:31 devstack sudo[80401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:03:31 devstack sudo[80401]: pam_unix(sudo:session): session closed for user root Apr 15 10:03:31 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:31 devstack cinder-volume[73523]: DEBUG cinder.manager [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Notifying Schedulers of capabilities ... {{(pid=73523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:03:41 devstack cinder-volume[73523]: DEBUG dbcounter [-] [73523] Writing DB stats cinder:SELECT=1 {{(pid=73523) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:03:41 devstack cinder-volume[73523]: DEBUG dbcounter [-] [73523] Writing DB stats cinder:UPDATE=1 {{(pid=73523) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:04:29 devstack cinder-volume[73523]: DEBUG oslo_service.periodic_task [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73523) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:04:29 devstack cinder-volume[73523]: DEBUG cinder.volume.drivers.lvm [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Updating volume stats {{(pid=73523) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:04:29 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:29 devstack sudo[82081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:04:29 devstack sudo[82081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:30 devstack sudo[82081]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:30 devstack sudo[82084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:04:30 devstack sudo[82084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:30 devstack sudo[82084]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:30 devstack sudo[82110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:04:30 devstack sudo[82110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:30 devstack sudo[82110]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:30 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:30 devstack sudo[82116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:04:30 devstack sudo[82116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:31 devstack sudo[82116]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:31 devstack cinder-volume[73523]: DEBUG oslo_concurrency.processutils [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.413s {{(pid=73523) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:31 devstack cinder-volume[73523]: DEBUG cinder.manager [None req-755e9b80-96ca-431e-893e-98a9462fab71 None None] Notifying Schedulers of capabilities ... {{(pid=73523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:04:47 devstack cinder-volume[73415]: INFO oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Caught SIGTERM, stopping children Apr 15 10:04:47 devstack cinder-volume[73415]: DEBUG oslo_concurrency.lockutils [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Acquiring lock "singleton_lock" {{(pid=73415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:04:47 devstack cinder-volume[73415]: DEBUG oslo_concurrency.lockutils [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Acquired lock "singleton_lock" {{(pid=73415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:04:47 devstack cinder-volume[73415]: DEBUG oslo_concurrency.lockutils [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Releasing lock "singleton_lock" {{(pid=73415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:04:47 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Stop services. {{(pid=73415) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 10:04:47 devstack cinder-volume[73415]: DEBUG oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Killing children. {{(pid=73415) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 10:04:47 devstack cinder-volume[73415]: INFO oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Waiting on 1 children to exit Apr 15 10:04:48 devstack cinder-volume[73523]: DEBUG oslo_concurrency.lockutils [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Acquiring lock "singleton_lock" {{(pid=73523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:04:48 devstack cinder-volume[73523]: DEBUG oslo_concurrency.lockutils [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Acquired lock "singleton_lock" {{(pid=73523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:04:48 devstack cinder-volume[73523]: DEBUG oslo_concurrency.lockutils [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Releasing lock "singleton_lock" {{(pid=73523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:04:48 devstack cinder-volume[73523]: WARNING amqp [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 10:04:48 devstack cinder-volume[73523]: WARNING amqp [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 10:04:48 devstack cinder-volume[73415]: INFO oslo_service.backend._eventlet.service [None req-a2046d9f-8311-4eb8-8ba5-f6544621e99a None None] Child 73523 exited with status 0 Apr 15 10:04:48 devstack cinder-volume[82624]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 10:04:48 devstack cinder-volume[82624]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:04:48 devstack cinder-volume[82624]: we strongly recommend against using it for new projects. Apr 15 10:04:48 devstack cinder-volume[82624]: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:04:48 devstack cinder-volume[82624]: framework. For more detail see Apr 15 10:04:48 devstack cinder-volume[82624]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:04:48 devstack cinder-volume[82624]: import eventlet # noqa Apr 15 10:04:50 devstack cinder-volume[82624]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82624) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:04:50 devstack cinder-volume[82624]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82624) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:04:50 devstack cinder-volume[82624]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82624) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:04:51 devstack cinder-volume[82624]: INFO dbcounter [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Registered counter for database cinder Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_db.sqlalchemy.engines [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG dbcounter [-] [82624] Writer thread running {{(pid=82624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:04:51 devstack cinder-volume[82624]: INFO cinder.rpc [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 10:04:51 devstack cinder-volume[82624]: INFO cinder.rpc [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_db.sqlalchemy.engines [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:04:51 devstack cinder-volume[82624]: INFO cinder.volume.manager [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Determined volume DB was empty at startup. Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG cinder.volume.manager [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82624) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 10:04:51 devstack cinder-volume[82624]: INFO cinder.volume.manager [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 10:04:51 devstack cinder-volume[82624]: WARNING stevedore.named [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 10:04:51 devstack cinder-volume[82624]: WARNING castellan.key_manager [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:04:51 devstack cinder-volume[82624]: WARNING cinder.keymgr.conf_key_mgr [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:04:51 devstack cinder-volume[82624]: INFO cinder.volume.manager [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_db.sqlalchemy.engines [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:04:51 devstack cinder-volume[82624]: INFO oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Starting 1 workers Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Started child 82741 {{(pid=82624) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Full set of CONF: {{(pid=82624) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] ******************************************************************************** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Configuration options gathered from: {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] ================================================================================ {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] allow_availability_zone_fallback = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82741]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] allow_compression_on_image_upload = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] allowed_direct_url_schemes = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] api_rate_limit = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] auth_strategy = keystone {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_availability_zone = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_host = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_stats_polling_interval = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backup_api_class = cinder.backup.api.API {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backup_name_template = backup-%s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backup_use_same_host = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backup_use_temp_snapshot = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] chap_password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] chap_username = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cinder_internal_tenant_project_id = a798c4ef8a074acca83eba7b053c5137 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cinder_internal_tenant_user_id = f37589c3fc594951873419d6fd25cec9 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cluster = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] compression_format = gzip {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] compute_api_class = cinder.compute.nova.API {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] config_dir = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] config_source = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] control_exchange = openstack {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] debug = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] default_availability_zone = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] default_group_type = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] default_volume_type = QuobyteHD {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] disk_geometry = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] driver_client_cert = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] driver_client_cert_key = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] driver_data_namespace = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] driver_ssl_cert_path = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] driver_ssl_cert_verify = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] driver_use_ssl = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] enable_new_services = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] enable_unsupported_driver = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] enabled_backends = ['QuobyteHD'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] enforce_multipath_for_image_xfer = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] filter_function = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance_api_insecure = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance_api_servers = ['http://192.168.122.152/image'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance_api_ssl_compression = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance_ca_certificates_file = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance_catalog_info = image:glance:publicURL {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance_certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance_keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance_num_retries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance_request_timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] goodness_function = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] graceful_shutdown_timeout = 5 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] group_api_class = cinder.group.api.API {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] host = devstack {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] image_compress_on_upload = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] image_conversion_address_space_limit = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] image_conversion_cpu_limit = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] image_conversion_disable = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] image_upload_use_cinder_backend = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] image_upload_use_internal_tenant = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] image_volume_cache_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] image_volume_cache_max_count = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] image_volume_cache_max_size_gb = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] init_host_max_objects_retrieval = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] instance_format = [instance: %(uuid)s] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] iscsi_target_flags = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] iscsi_write_cache = on {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] iser_helper = tgtadm {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] iser_ip_address = 192.168.122.152 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] iser_port = 3260 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] log_color = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] log_config_append = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] log_dir = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] log_file = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] log_options = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] log_rotate_interval = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] log_rotate_interval_type = days {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] log_rotation_type = none {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] max_age = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82741]: INFO cinder.volume.manager [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] max_logfile_count = 30 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82741]: DEBUG cinder.volume.drivers.remotefs [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82741) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] max_logfile_size_mb = 200 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] max_over_subscription_ratio = 20.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] message_reap_interval = 86400 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] message_ttl = 2592000 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] migration_create_volume_timeout_secs = 300 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] monkey_patch = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] monkey_patch_modules = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] my_ip = 192.168.122.152 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] no_snapshot_gb_quota = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] num_iser_scan_tries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] num_shell_tries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] num_volume_device_scan_tries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] nvmeof_conn_info_version = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] nvmet_ns_id = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] nvmet_port_id = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] osapi_max_limit = 1000 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] osapi_volume_ext_list = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] osapi_volume_listen_port = 8776 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] osapi_volume_use_ssl = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] osapi_volume_workers = 2 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] per_volume_size_limit = -1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] periodic_fuzzy_delay = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] periodic_interval = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] public_endpoint = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] publish_errors = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] quota_backup_gigabytes = 1000 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] quota_backups = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] quota_gigabytes = 1000 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] quota_groups = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] quota_snapshots = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] quota_volumes = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] rate_limit_burst = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] rate_limit_except_level = CRITICAL {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] rate_limit_interval = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] reinit_driver_count = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] replication_device = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] report_discard_supported = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] report_interval = 120 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] reservation_clean_interval = 86400 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] reservation_expire = 86400 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] reserved_image_namespaces = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] reserved_percentage = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] rpc_response_timeout = 120 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] run_external_periodic_tasks = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] scst_target_driver = iscsi {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] scst_target_iqn_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] service_down_time = 720 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] shell_completion = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] snapshot_name_template = snapshot-%s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] split_loggers = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] state_path = /opt/stack/data/cinder {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] storage_availability_zone = nova {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] storage_protocol = iSCSI {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] syslog_log_facility = LOG_USER {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] target_helper = lioadm {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] target_ip_address = 192.168.122.152 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] target_port = 3260 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] target_protocol = iscsi {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] target_secondary_ip_addresses = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] trace_flags = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] transport_url = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] until_refresh = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] use_chap_auth = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] use_default_quota_class = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] use_journal = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] use_json = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] use_multipath_for_image_xfer = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] use_stderr = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] use_syslog = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] verify_glance_signatures = enabled {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] volume_api_class = cinder.volume.api.API {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] volume_backend_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] volume_clear = zero {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] volume_clear_ionice = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] volume_clear_size = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] volume_copy_bps_limit = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] volume_dd_blocksize = 1M {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] volume_name_template = volume-%s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] volume_service_inithost_offload = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] volume_usage_audit_period = month {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] zoning_mode = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_concurrency.disable_process_locking = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.admin_password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.admin_token = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.admin_user = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.auth_port = 35357 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.auth_protocol = https {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.auth_section = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.auth_type = password {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.auth_uri = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.auth_version = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.cache = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.identity_uri = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.include_service_catalog = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.insecure = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.interface = public {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_password = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcache_username = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.region_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.service_type = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.152/identity {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.backend = dogpile.cache.null {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.backend_argument = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.backend_expiration_time = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.config_prefix = cache.oslo {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.debug_cache_backend = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.enable_retry_client = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.enable_socket_keepalive = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.enforce_fips_mode = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.expiration_time = 600 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.hashclient_retry_attempts = 2 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.memcache_dead_retry = 300 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.memcache_pool_maxsize = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.memcache_sasl_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.proxies = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.redis_db = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.redis_server = localhost:6379 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.retry_attempts = 2 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.retry_delay = 0.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.socket_keepalive_count = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.socket_keepalive_idle = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.socket_keepalive_interval = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.socket_timeout = 1.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.tls_allowed_ciphers = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.tls_cafile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.tls_certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.tls_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.tls_keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cache.username = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] coordination.backend_url = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.asyncio_connection = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.asyncio_slave_connection = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.backend = sqlalchemy {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.connection = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.connection_debug = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.connection_parameters = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82741]: DEBUG cinder.volume.drivers.quobyte [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82741) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.connection_recycle_time = 3600 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82741]: WARNING cinder.volume.drivers.quobyte [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.connection_trace = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82741]: WARNING cinder.volume.drivers.quobyte [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.db_inc_retry_interval = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.db_max_retries = 20 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.db_max_retry_interval = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.db_retry_interval = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.max_overflow = 50 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.max_pool_size = 5 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82741]: DEBUG oslo_concurrency.processutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Running cmd (subprocess): mount.quobyte {{(pid=82741) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.max_retries = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.mysql_wsrep_sync_wait = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.pool_timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.retry_interval = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.slave_connection = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.sqlite_synchronous = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.synchronous_reader = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] database.use_db_reconnect = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler.connection_string = messaging:// {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler.enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler.es_doc_type = notification {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler.es_scroll_size = 10000 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler.es_scroll_time = 2m {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler.filter_error_trace = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler.hmac_keys = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler.sentinel_service_name = mymaster {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler.socket_timeout = 0.1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler.trace_requests = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler.trace_sqlalchemy = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler_jaeger.process_tags = {} {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler_jaeger.service_name_prefix = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] profiler_otlp.service_name_prefix = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_policy.enforce_new_defaults = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: WARNING oslo_config.cfg [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_policy.enforce_scope = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_policy.policy_default_rule = default {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_policy.policy_file = policy.yaml {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] privsep_osbrick.group = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] privsep_osbrick.helper_command = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] privsep_osbrick.user = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cinder_sys_admin.group = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cinder_sys_admin.helper_command = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] cinder_sys_admin.user = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] service_user.auth_section = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] service_user.auth_type = password {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] service_user.cafile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] service_user.certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] service_user.collect_timing = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] service_user.insecure = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] service_user.keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] service_user.send_service_user_token = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] service_user.split_loggers = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] service_user.timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance.auth_section = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance.auth_type = password {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance.certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance.collect_timing = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance.insecure = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance.keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance.region_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance.split_loggers = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] glance.timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.backend_availability_zone = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.chap_password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.chap_username = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.disk_geometry = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.driver_client_cert = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.driver_client_cert_key = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.driver_data_namespace = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.driver_use_ssl = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.extra_capabilities = {} {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.filter_function = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.goodness_function = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.iscsi_target_flags = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.iscsi_write_cache = on {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.iser_helper = tgtadm {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.iser_ip_address = 192.168.122.152 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.iser_port = 3260 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.nas_host = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.nas_login = admin {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.nas_mount_options = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.nas_password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.nas_private_key = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.nas_share_path = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.num_shell_tries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.quobyte_volume_url = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.replication_device = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.report_discard_supported = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.reserved_percentage = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.target_helper = tgtadm {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.target_ip_address = 192.168.122.152 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.target_port = 3260 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.target_protocol = iscsi {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.trace_flags = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.unique_fqdn_network = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.use_chap_auth = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.volume_backend_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:51 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.volume_clear = zero {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.volume_clear_ionice = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.volume_clear_size = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_reports.file_event_handler = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_reports.log_dir = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.backend_availability_zone = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.backend_host = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.chap_password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.chap_username = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.chiscsi_conf = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.disk_geometry = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.driver_client_cert = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.driver_data_namespace = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.driver_use_ssl = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.extra_capabilities = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.filter_function = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.goodness_function = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.iser_helper = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.iser_ip_address = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.iser_port = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.iser_target_prefix = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.nas_host = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.nas_login = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.nas_mount_options = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.nas_password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.nas_private_key = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.nas_share_path = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.nas_ssh_port = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.num_shell_tries = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.nvmet_port_id = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.replication_device = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.report_discard_supported = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.reserved_percentage = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.scst_target_driver = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.storage_protocol = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.target_helper = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.target_ip_address = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.target_port = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.target_prefix = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.target_protocol = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.trace_flags = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.use_chap_auth = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.volume_clear = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.volume_clear_size = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] QuobyteHD.volumes_dir = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack quobyte-client[82742]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 10:04:52 devstack quobyte-client[82742]: Invalid parameters found, error: missing mount point. Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack quobyte-client[82742]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack quobyte-client[82742]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.ssl = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_notifications.driver = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_notifications.retry = -1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] key_manager.fixed_key = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.barbican_api_version = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.barbican_endpoint = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.barbican_endpoint_type = public {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.barbican_region_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.cafile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.collect_timing = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.insecure = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.number_of_retries = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.retry_delay = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.send_service_user_token = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.split_loggers = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.verify_ssl = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican.verify_ssl_path = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican_service_user.auth_section = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican_service_user.auth_type = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican_service_user.cafile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican_service_user.certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican_service_user.collect_timing = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican_service_user.insecure = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican_service_user.keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican_service_user.split_loggers = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] barbican_service_user.timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] vault.approle_role_id = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] vault.approle_secret_id = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] vault.kv_mountpoint = secret {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] vault.kv_path = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG oslo_concurrency.processutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=82741) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] vault.kv_version = 2 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] vault.namespace = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] vault.root_token_id = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82741) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] vault.ssl_ca_crt_file = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82741) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] vault.timeout = 60.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG cinder.volume.drivers.quobyte [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=82741) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] vault.use_ssl = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:52 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] ******************************************************************************** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 10:04:52 devstack cinder-volume[82741]: INFO cinder.volume.drivers.quobyte [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b ... Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG oslo_concurrency.processutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 -c /etc/quobyte/client-cinder.cfg {{(pid=82741) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:52 devstack sudo[82743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 -c /etc/quobyte/client-cinder.cfg Apr 15 10:04:52 devstack sudo[82743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:52 devstack sudo[82743]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG oslo_concurrency.processutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.483s {{(pid=82741) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:52 devstack cinder-volume[82741]: INFO cinder.volume.drivers.quobyte [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b succeeded Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG cinder.volume.drivers.quobyte [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=82741) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.489s {{(pid=82741) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG oslo_concurrency.processutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=82741) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:52 devstack sudo[82812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:04:52 devstack sudo[82812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:52 devstack sudo[82812]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG oslo_concurrency.processutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.376s {{(pid=82741) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:52 devstack cinder-volume[82741]: INFO cinder.volume.driver [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Driver hasn't implemented _init_vendor_properties() Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG cinder.volume.driver [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.710105895996, 'free_capacity_gb': 1775.710105895996, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82741) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG oslo_db.sqlalchemy.engines [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG dbcounter [-] [82741] Writer thread running {{(pid=82741) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG cinder.db.sqlalchemy.api [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Building query based on filter {{(pid=82741) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG cinder.image.image_utils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82741) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 10:04:52 devstack cinder-volume[82741]: INFO cinder.keymgr.migration [None req-77662b87-6f6d-466c-b59f-56fd9a26de56 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82741) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82741) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG cinder.volume.drivers.quobyte [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=82741) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG cinder.volume.drivers.quobyte [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=82741) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82741) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:04:52 devstack cinder-volume[82741]: DEBUG oslo_concurrency.processutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=82741) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:52 devstack sudo[82815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:04:52 devstack sudo[82815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:53 devstack sudo[82815]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:53 devstack cinder-volume[82741]: DEBUG oslo_concurrency.processutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.383s {{(pid=82741) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:53 devstack cinder-volume[82741]: DEBUG cinder.manager [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Notifying Schedulers of capabilities ... {{(pid=82741) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:04:53 devstack cinder-volume[82741]: INFO cinder.volume.manager [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Driver initialization completed successfully. Apr 15 10:04:53 devstack cinder-volume[82741]: INFO cinder.manager [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Initiating service 3 cleanup Apr 15 10:04:53 devstack cinder-volume[82741]: INFO cinder.manager [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Service 3 cleanup completed. Apr 15 10:04:53 devstack cinder-volume[82741]: DEBUG cinder.service [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Creating RPC server for service cinder-volume {{(pid=82741) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 10:04:53 devstack cinder-volume[82741]: DEBUG cinder.service [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82741) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 10:04:53 devstack cinder-volume[82741]: INFO cinder.volume.manager [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 10:04:53 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82741) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:04:53 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82741) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:04:53 devstack cinder-volume[82741]: DEBUG cinder.volume.drivers.quobyte [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=82741) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:04:53 devstack cinder-volume[82741]: DEBUG cinder.volume.drivers.quobyte [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=82741) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:04:53 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82741) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:04:53 devstack cinder-volume[82741]: DEBUG oslo_concurrency.processutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=82741) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:53 devstack sudo[82820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:04:53 devstack sudo[82820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:53 devstack sudo[82820]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:53 devstack cinder-volume[82741]: DEBUG oslo_concurrency.processutils [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.461s {{(pid=82741) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:53 devstack cinder-volume[82741]: INFO cinder.volume.manager [None req-53e76ec8-1b87-48e9-abcf-93439ba236df None None] Driver post RPC initialization completed successfully. Apr 15 10:04:56 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-623cf233-5b4c-4a72-b528-d1a7360cb427 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82741) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:04:56 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-623cf233-5b4c-4a72-b528-d1a7360cb427 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82741) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:04:56 devstack cinder-volume[82741]: DEBUG cinder.volume.drivers.quobyte [None req-623cf233-5b4c-4a72-b528-d1a7360cb427 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=82741) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:04:56 devstack cinder-volume[82741]: DEBUG cinder.volume.drivers.quobyte [None req-623cf233-5b4c-4a72-b528-d1a7360cb427 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=82741) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:04:56 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-623cf233-5b4c-4a72-b528-d1a7360cb427 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82741) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:04:56 devstack cinder-volume[82741]: DEBUG oslo_concurrency.processutils [None req-623cf233-5b4c-4a72-b528-d1a7360cb427 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=82741) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:56 devstack sudo[82888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:04:56 devstack sudo[82888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:57 devstack sudo[82888]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:57 devstack cinder-volume[82741]: DEBUG oslo_concurrency.processutils [None req-623cf233-5b4c-4a72-b528-d1a7360cb427 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.372s {{(pid=82741) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:57 devstack cinder-volume[82741]: DEBUG cinder.manager [None req-623cf233-5b4c-4a72-b528-d1a7360cb427 None None] Notifying Schedulers of capabilities ... {{(pid=82741) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:05:00 devstack cinder-volume[82624]: INFO oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Caught SIGTERM, stopping children Apr 15 10:05:00 devstack cinder-volume[82624]: DEBUG oslo_concurrency.lockutils [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Acquiring lock "singleton_lock" {{(pid=82624) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:05:00 devstack cinder-volume[82624]: DEBUG oslo_concurrency.lockutils [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Acquired lock "singleton_lock" {{(pid=82624) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:05:00 devstack cinder-volume[82624]: DEBUG oslo_concurrency.lockutils [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Releasing lock "singleton_lock" {{(pid=82624) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:05:00 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Stop services. {{(pid=82624) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 10:05:00 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Killing children. {{(pid=82624) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 10:05:00 devstack cinder-volume[82624]: INFO oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Waiting on 1 children to exit Apr 15 10:05:01 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Acquiring lock "singleton_lock" {{(pid=82741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:05:01 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Acquired lock "singleton_lock" {{(pid=82741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:05:01 devstack cinder-volume[82741]: DEBUG oslo_concurrency.lockutils [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Releasing lock "singleton_lock" {{(pid=82741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:05:01 devstack cinder-volume[82741]: WARNING amqp [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 10:05:01 devstack cinder-volume[82741]: WARNING amqp [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 10:05:01 devstack cinder-volume[82624]: INFO oslo_service.backend._eventlet.service [None req-7573703c-2ff0-4139-b47c-27e972cc8b27 None None] Child 82741 exited with status 0 Apr 15 10:05:02 devstack cinder-volume[82963]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 10:05:02 devstack cinder-volume[82963]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:05:02 devstack cinder-volume[82963]: we strongly recommend against using it for new projects. Apr 15 10:05:02 devstack cinder-volume[82963]: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:05:02 devstack cinder-volume[82963]: framework. For more detail see Apr 15 10:05:02 devstack cinder-volume[82963]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:05:02 devstack cinder-volume[82963]: import eventlet # noqa Apr 15 10:05:03 devstack cinder-volume[82963]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:05:03 devstack cinder-volume[82963]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:05:03 devstack cinder-volume[82963]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:05:04 devstack cinder-volume[82963]: INFO dbcounter [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] Registered counter for database cinder Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_db.sqlalchemy.engines [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG dbcounter [-] [82963] Writer thread running {{(pid=82963) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:05:04 devstack cinder-volume[82963]: INFO cinder.rpc [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 10:05:04 devstack cinder-volume[82963]: INFO cinder.rpc [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_db.sqlalchemy.engines [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:05:04 devstack cinder-volume[82963]: INFO cinder.volume.manager [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] Determined volume DB was empty at startup. Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG cinder.volume.manager [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82963) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 10:05:04 devstack cinder-volume[82963]: WARNING stevedore.named [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 10:05:04 devstack cinder-volume[82963]: WARNING castellan.key_manager [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:05:04 devstack cinder-volume[82963]: WARNING cinder.keymgr.conf_key_mgr [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:05:04 devstack cinder-volume[82963]: INFO cinder.volume.manager [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_db.sqlalchemy.engines [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:05:04 devstack cinder-volume[82963]: INFO oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] Starting 1 workers Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] Started child 83167 {{(pid=82963) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] Full set of CONF: {{(pid=82963) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] ******************************************************************************** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] Configuration options gathered from: {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] ================================================================================ {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] allow_availability_zone_fallback = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] allow_compression_on_image_upload = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] allowed_direct_url_schemes = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] api_rate_limit = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] auth_strategy = keystone {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_availability_zone = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_host = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_stats_polling_interval = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backup_api_class = cinder.backup.api.API {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backup_name_template = backup-%s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backup_use_same_host = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backup_use_temp_snapshot = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] chap_password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] chap_username = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cinder_internal_tenant_project_id = a798c4ef8a074acca83eba7b053c5137 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cinder_internal_tenant_user_id = f37589c3fc594951873419d6fd25cec9 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cluster = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] compression_format = gzip {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] compute_api_class = cinder.compute.nova.API {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] config_dir = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] config_source = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[83167]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] control_exchange = openstack {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] debug = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] default_availability_zone = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] default_group_type = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] default_volume_type = QuobyteHD {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] disk_geometry = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] driver_client_cert = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] driver_client_cert_key = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] driver_data_namespace = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] driver_ssl_cert_path = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] driver_ssl_cert_verify = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] driver_use_ssl = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] enable_new_services = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] enable_unsupported_driver = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] enabled_backends = ['QuobyteHD'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] enforce_multipath_for_image_xfer = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] filter_function = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance_api_insecure = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance_api_servers = ['http://192.168.122.152/image'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance_api_ssl_compression = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance_ca_certificates_file = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance_catalog_info = image:glance:publicURL {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance_certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance_keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance_num_retries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance_request_timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] goodness_function = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] graceful_shutdown_timeout = 5 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] group_api_class = cinder.group.api.API {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] host = devstack {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] image_compress_on_upload = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] image_conversion_address_space_limit = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] image_conversion_cpu_limit = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] image_conversion_disable = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] image_upload_use_cinder_backend = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] image_upload_use_internal_tenant = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] image_volume_cache_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] image_volume_cache_max_count = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] image_volume_cache_max_size_gb = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] init_host_max_objects_retrieval = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] instance_format = [instance: %(uuid)s] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] iscsi_target_flags = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] iscsi_write_cache = on {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] iser_helper = tgtadm {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] iser_ip_address = 192.168.122.152 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] iser_port = 3260 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] log_color = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] log_config_append = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] log_dir = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] log_file = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] log_options = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] log_rotate_interval = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] log_rotate_interval_type = days {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] log_rotation_type = none {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] max_age = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] max_logfile_count = 30 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] max_logfile_size_mb = 200 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] max_over_subscription_ratio = 20.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] message_reap_interval = 86400 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] message_ttl = 2592000 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] migration_create_volume_timeout_secs = 300 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] monkey_patch = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] monkey_patch_modules = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] my_ip = 192.168.122.152 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] no_snapshot_gb_quota = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] num_iser_scan_tries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] num_shell_tries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] num_volume_device_scan_tries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] nvmeof_conn_info_version = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] nvmet_ns_id = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] nvmet_port_id = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] osapi_max_limit = 1000 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] osapi_volume_ext_list = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] osapi_volume_listen = 0.0.0.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] osapi_volume_listen_port = 8776 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] osapi_volume_use_ssl = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] osapi_volume_workers = 2 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] per_volume_size_limit = -1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] periodic_fuzzy_delay = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] periodic_interval = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] project_id_regex = [0-9a-f\-]+ {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] public_endpoint = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] publish_errors = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] quota_backup_gigabytes = 1000 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] quota_backups = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] quota_gigabytes = 1000 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] quota_groups = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] quota_snapshots = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] quota_volumes = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] rate_limit_burst = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] rate_limit_except_level = CRITICAL {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] rate_limit_interval = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] reinit_driver_count = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] replication_device = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] report_discard_supported = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] report_interval = 120 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] reservation_clean_interval = 86400 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] reservation_expire = 86400 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] reserved_image_namespaces = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] reserved_percentage = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] rpc_response_timeout = 120 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] run_external_periodic_tasks = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] scst_target_driver = iscsi {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] scst_target_iqn_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] service_down_time = 720 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] shell_completion = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] snapshot_name_template = snapshot-%s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] split_loggers = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] state_path = /opt/stack/data/cinder {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] storage_availability_zone = nova {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] storage_protocol = iSCSI {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] syslog_log_facility = LOG_USER {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] target_helper = lioadm {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] target_ip_address = 192.168.122.152 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] target_port = 3260 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] target_protocol = iscsi {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:04 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] target_secondary_ip_addresses = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] trace_flags = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] transfer_api_class = cinder.transfer.api.API {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] transport_url = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] until_refresh = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] use_chap_auth = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] use_default_quota_class = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] use_journal = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] use_json = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] use_multipath_for_image_xfer = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] use_stderr = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] use_syslog = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] verify_glance_signatures = enabled {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] volume_api_class = cinder.volume.api.API {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] volume_backend_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] volume_clear = zero {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] volume_clear_ionice = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] volume_clear_size = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] volume_copy_bps_limit = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] volume_dd_blocksize = 1M {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] volume_name_template = volume-%s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] volume_service_inithost_offload = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] volume_usage_audit_period = month {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] zoning_mode = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_concurrency.disable_process_locking = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.admin_password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.admin_token = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.admin_user = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.auth_admin_prefix = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.auth_port = 35357 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.auth_protocol = https {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.auth_section = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.auth_type = password {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.auth_uri = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.auth_version = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.cache = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.delay_auth_decision = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.http_connect_timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.identity_uri = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.include_service_catalog = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.insecure = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.interface = public {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_password = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcache_username = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.region_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.service_token_roles_required = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.service_type = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83167) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.token_cache_time = 300 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.152/identity {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.backend = dogpile.cache.null {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.backend_argument = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.backend_expiration_time = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.config_prefix = cache.oslo {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.debug_cache_backend = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.enable_retry_client = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.enable_socket_keepalive = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.enforce_fips_mode = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.expiration_time = 600 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.hashclient_retry_attempts = 2 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.memcache_dead_retry = 300 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.memcache_pool_maxsize = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.memcache_sasl_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.proxies = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.redis_db = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.redis_sentinel_service_name = mymaster {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.redis_server = localhost:6379 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.retry_attempts = 2 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.retry_delay = 0.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.socket_keepalive_count = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.socket_keepalive_idle = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.socket_keepalive_interval = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.socket_timeout = 1.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.tls_allowed_ciphers = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.tls_cafile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.tls_certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.tls_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.tls_keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cache.username = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] coordination.backend_url = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.asyncio_connection = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.asyncio_slave_connection = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.backend = sqlalchemy {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.connection = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.connection_debug = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.connection_parameters = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.connection_recycle_time = 3600 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.connection_trace = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.db_inc_retry_interval = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.db_max_retries = 20 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.db_max_retry_interval = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.db_retry_interval = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.max_overflow = 50 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.max_pool_size = 5 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.max_retries = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.mysql_wsrep_sync_wait = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.pool_timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.retry_interval = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.slave_connection = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.sqlite_synchronous = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.synchronous_reader = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] database.use_db_reconnect = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler.connection_string = messaging:// {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler.enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler.es_doc_type = notification {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler.es_scroll_size = 10000 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler.es_scroll_time = 2m {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler.filter_error_trace = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler.hmac_keys = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler.sentinel_service_name = mymaster {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler.socket_timeout = 0.1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler.trace_requests = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler.trace_sqlalchemy = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler_jaeger.process_tags = {} {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler_jaeger.service_name_prefix = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] profiler_otlp.service_name_prefix = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_policy.enforce_new_defaults = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: WARNING oslo_config.cfg [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_policy.enforce_scope = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_policy.policy_default_rule = default {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_policy.policy_file = policy.yaml {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_policy.remote_timeout = 60.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] privsep_osbrick.group = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] privsep_osbrick.helper_command = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] privsep_osbrick.user = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cinder_sys_admin.group = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cinder_sys_admin.helper_command = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] cinder_sys_admin.user = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] service_user.auth_section = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] service_user.auth_type = password {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] service_user.cafile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] service_user.certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] service_user.collect_timing = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] service_user.insecure = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] service_user.keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] service_user.send_service_user_token = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] service_user.split_loggers = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] service_user.timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance.auth_section = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance.auth_type = password {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance.certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance.collect_timing = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance.insecure = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance.keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance.region_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance.split_loggers = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] glance.timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.backend_availability_zone = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.chap_password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.chap_username = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.disk_geometry = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.driver_client_cert = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.driver_client_cert_key = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.driver_data_namespace = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.driver_use_ssl = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.enable_unsupported_driver = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.extra_capabilities = {} {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.filter_function = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.goodness_function = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.iscsi_target_flags = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.iscsi_write_cache = on {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.iser_helper = tgtadm {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.iser_ip_address = 192.168.122.152 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.iser_port = 3260 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.nas_host = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.nas_login = admin {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.nas_mount_options = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.nas_password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.nas_private_key = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.nas_share_path = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.nas_ssh_port = 22 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.num_shell_tries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.nvmet_port_id = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.quobyte_client_cfg = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.quobyte_volume_url = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.replication_device = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.report_discard_supported = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.reserved_percentage = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.scst_target_driver = iscsi {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.scst_target_iqn_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.storage_protocol = iSCSI {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.target_helper = tgtadm {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.target_ip_address = 192.168.122.152 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.target_port = 3260 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.target_protocol = iscsi {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.trace_flags = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.unique_fqdn_network = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.use_chap_auth = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.volume_backend_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.volume_clear = zero {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.volume_clear_ionice = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.volume_clear_size = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_reports.file_event_handler = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_reports.log_dir = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack quobyte-client[83182]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.backend_availability_zone = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.backend_host = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.chap_password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.chap_username = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.chiscsi_conf = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack quobyte-client[83182]: Invalid parameters found, error: missing mount point. Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.disk_geometry = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.driver_client_cert = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.driver_client_cert_key = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.driver_data_namespace = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.driver_use_ssl = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack quobyte-client[83182]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.extra_capabilities = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.filter_function = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.goodness_function = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack quobyte-client[83182]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.iscsi_target_flags = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.iscsi_write_cache = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.iser_helper = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.iser_ip_address = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.iser_port = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.iser_target_prefix = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.nas_host = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.nas_login = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.nas_mount_options = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.nas_password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.nas_private_key = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.nas_share_path = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.nas_ssh_port = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.num_shell_tries = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.nvmet_ns_id = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.nvmet_port_id = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.replication_device = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.report_discard_supported = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.reserved_percentage = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.scst_target_driver = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.storage_protocol = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.target_helper = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.target_ip_address = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.target_port = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.target_prefix = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.target_protocol = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.trace_flags = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.unique_fqdn_network = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.use_chap_auth = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.volume_clear = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.volume_clear_ionice = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.volume_clear_size = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] QuobyteHD.volumes_dir = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.ssl = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.ssl_version = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_notifications.driver = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_notifications.retry = -1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] oslo_messaging_notifications.transport_url = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] key_manager.fixed_key = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.barbican_api_version = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.barbican_endpoint = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.barbican_endpoint_type = public {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.barbican_region_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.cafile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.collect_timing = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.insecure = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.number_of_retries = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.retry_delay = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.send_service_user_token = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.split_loggers = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.verify_ssl = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican.verify_ssl_path = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack sudo[83184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83167) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 10:05:05 devstack sudo[83184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican_service_user.auth_section = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican_service_user.auth_type = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican_service_user.cafile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican_service_user.certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican_service_user.collect_timing = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican_service_user.insecure = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican_service_user.keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican_service_user.split_loggers = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] barbican_service_user.timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] vault.approle_role_id = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] vault.approle_secret_id = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] vault.kv_mountpoint = secret {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] vault.kv_path = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] vault.kv_version = 2 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] vault.namespace = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] vault.root_token_id = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] vault.ssl_ca_crt_file = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] vault.timeout = 60.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] vault.use_ssl = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:05:05 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-bbcce7e6-2d11-4174-8e02-4c98902a1b0d None None] ******************************************************************************** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 10:05:05 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.quobyte [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 10:05:05 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.quobyte [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Running cmd (subprocess): mount.quobyte {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:05:05 devstack sudo[83184]: pam_unix(sudo:session): session closed for user root Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.612s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:05:05 devstack cinder-volume[83167]: INFO cinder.volume.driver [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG cinder.volume.driver [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6867942810059, 'free_capacity_gb': 1775.6867942810059, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83167) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG oslo_db.sqlalchemy.engines [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83167) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writer thread running {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG cinder.db.sqlalchemy.api [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Building query based on filter {{(pid=83167) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83167) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:05:05 devstack cinder-volume[83167]: INFO cinder.keymgr.migration [None req-f49bef77-63ea-435b-b137-98e6e12f1e79 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 10:05:05 devstack sudo[83203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:05:05 devstack sudo[83203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:05:06 devstack sudo[83203]: pam_unix(sudo:session): session closed for user root Apr 15 10:05:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.404s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:05:06 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:05:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Driver initialization completed successfully. Apr 15 10:05:06 devstack cinder-volume[83167]: INFO cinder.manager [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Initiating service 3 cleanup Apr 15 10:05:06 devstack cinder-volume[83167]: INFO cinder.manager [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Service 3 cleanup completed. Apr 15 10:05:06 devstack cinder-volume[83167]: DEBUG cinder.service [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Creating RPC server for service cinder-volume {{(pid=83167) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 10:05:06 devstack cinder-volume[83167]: DEBUG cinder.service [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83167) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 10:05:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 10:05:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:05:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:05:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:05:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:05:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:05:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:05:06 devstack sudo[83210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:05:06 devstack sudo[83210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:05:06 devstack sudo[83210]: pam_unix(sudo:session): session closed for user root Apr 15 10:05:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.415s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:05:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c29031f1-a517-4d18-a717-069969e5c420 None None] Driver post RPC initialization completed successfully. Apr 15 10:05:14 devstack cinder-volume[82963]: DEBUG dbcounter [-] [82963] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82963) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:05:16 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:05:16 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=3 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Flow 'volume_create_manager' (b1a06967-8493-4309-bd90-d2e10a7f81cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee5e73c-b545-4da9-b6a8-163923af09d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee5e73c-b545-4da9-b6a8-163923af09d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-828671730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e672bf9-3e45-44ca-a13c-502a2baf99d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='389f171502dc44079118e64657147a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:06Z,use_quota=True,user_id='b64f7670afe541e78239652241721bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee81db33-06fa-45e6-8ce2-a831de1d58bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee81db33-06fa-45e6-8ce2-a831de1d58bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a1d151-d824-42f5-b6a5-68ca54c65695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a1d151-d824-42f5-b6a5-68ca54c65695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e672bf9-3e45-44ca-a13c-502a2baf99d4', 'volume_name': 'volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c071678e-ee70-414e-adc6-2b1b4f44ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c071678e-ee70-414e-adc6-2b1b4f44ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11cd0a7b-91aa-4608-b369-b9c79aff29d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:05 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Volume 3e672bf9-3e45-44ca-a13c-502a2baf99d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4', 'volume_size': 1} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-828671730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e672bf9-3e45-44ca-a13c-502a2baf99d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='389f171502dc44079118e64657147a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:06Z,use_quota=True,user_id='b64f7670afe541e78239652241721bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Creating volume 3e672bf9-3e45-44ca-a13c-502a2baf99d4 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:06:05 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Flow 'volume_create_manager' (3ac480ea-2495-4f4a-85b1-8eff429b9d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c0688f-91fd-4bce-9788-8407d4033145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c0688f-91fd-4bce-9788-8407d4033145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1809880703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2997d7bb-1a6e-4177-bffb-b793405e690f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51dd57ead6574177b2c6db85dc1c4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:06Z,use_quota=True,user_id='6d8d83ed64484da393eb7e2fe2aa755a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5374db4-706e-4792-a9e2-50b200e8640e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5374db4-706e-4792-a9e2-50b200e8640e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69f7657-6432-42b9-a821-bd5657f3dee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:05 devstack sudo[83586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 1073741824 Apr 15 10:06:05 devstack sudo[83586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69f7657-6432-42b9-a821-bd5657f3dee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2997d7bb-1a6e-4177-bffb-b793405e690f', 'volume_name': 'volume-2997d7bb-1a6e-4177-bffb-b793405e690f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48559f19-788f-44a4-b3b2-fbcc82ff9f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48559f19-788f-44a4-b3b2-fbcc82ff9f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d12d96-c068-4579-87ca-6855b435506a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:05 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Volume 2997d7bb-1a6e-4177-bffb-b793405e690f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2997d7bb-1a6e-4177-bffb-b793405e690f', 'volume_size': 1} Apr 15 10:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Flow 'volume_create_manager' (e54e9628-9f00-438a-91cd-eae853f52a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec854bd-873d-4070-ac22-c867d76eff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec854bd-873d-4070-ac22-c867d76eff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:05:50Z,deleted=False,deleted_at=None,display_description='',display_name='28b04b8e-72c6-48e1-9be4-e3f74924cdb2-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910a0e13-5678-4cee-929a-7511ebe1d147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9383ac5299143f3ba6b1ea3bf3f7305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:06Z,use_quota=True,user_id='0fae784f5f394be4af3158d60b824fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64241b2-d310-4abc-a6d0-f49c290ee48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64241b2-d310-4abc-a6d0-f49c290ee48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3f3e78-aa33-432f-a410-6a489cff6f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3f3e78-aa33-432f-a410-6a489cff6f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910a0e13-5678-4cee-929a-7511ebe1d147', 'volume_name': 'volume-910a0e13-5678-4cee-929a-7511ebe1d147', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c6ae5d-0575-4045-94be-18b6eac7591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c6ae5d-0575-4045-94be-18b6eac7591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf16555-9bdf-4fe6-a796-824492f269e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:06 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Volume 910a0e13-5678-4cee-929a-7511ebe1d147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910a0e13-5678-4cee-929a-7511ebe1d147', 'volume_size': 1} Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:06 devstack sudo[83586]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 1073741824" returned: 0 in 0.910s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:06 devstack sudo[83911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 Apr 15 10:06:06 devstack sudo[83911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:07 devstack sudo[83911]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4" returned: 0 in 0.475s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.311s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1809880703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2997d7bb-1a6e-4177-bffb-b793405e690f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51dd57ead6574177b2c6db85dc1c4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:06Z,use_quota=True,user_id='6d8d83ed64484da393eb7e2fe2aa755a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Creating volume 2997d7bb-1a6e-4177-bffb-b793405e690f {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:06:07 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2997d7bb-1a6e-4177-bffb-b793405e690f 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11cd0a7b-91aa-4608-b369-b9c79aff29d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:07 devstack sudo[83915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2997d7bb-1a6e-4177-bffb-b793405e690f 1073741824 Apr 15 10:06:07 devstack sudo[83915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a623381-fc42-42c7-b425-e9a181f3e4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Volume volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 (3e672bf9-3e45-44ca-a13c-502a2baf99d4): created successfully Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a623381-fc42-42c7-b425-e9a181f3e4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Flow 'volume_create_manager' (b1a06967-8493-4309-bd90-d2e10a7f81cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-49a845b5-db53-42db-b0cd-f395f4230aba req-031f159f-e3bd-4e17-ae6a-cb2426ddc5e6 tempest-VolumesSnapshotsTestJSON-157023151 None] Created volume successfully. Apr 15 10:06:07 devstack sudo[83915]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2997d7bb-1a6e-4177-bffb-b793405e690f 1073741824" returned: 0 in 0.561s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2997d7bb-1a6e-4177-bffb-b793405e690f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:07 devstack sudo[83928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2997d7bb-1a6e-4177-bffb-b793405e690f Apr 15 10:06:07 devstack sudo[83928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:08 devstack sudo[83928]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2997d7bb-1a6e-4177-bffb-b793405e690f" returned: 0 in 0.452s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.096s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:05:50Z,deleted=False,deleted_at=None,display_description='',display_name='28b04b8e-72c6-48e1-9be4-e3f74924cdb2-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910a0e13-5678-4cee-929a-7511ebe1d147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9383ac5299143f3ba6b1ea3bf3f7305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:06Z,use_quota=True,user_id='0fae784f5f394be4af3158d60b824fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Creating volume 910a0e13-5678-4cee-929a-7511ebe1d147 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:06:08 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d12d96-c068-4579-87ca-6855b435506a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2997d7bb-1a6e-4177-bffb-b793405e690f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa2ca89-3801-49f2-bc05-1e3c41e059e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:08 devstack sudo[83932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147 1073741824 Apr 15 10:06:08 devstack sudo[83932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:08 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Volume volume-2997d7bb-1a6e-4177-bffb-b793405e690f (2997d7bb-1a6e-4177-bffb-b793405e690f): created successfully Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa2ca89-3801-49f2-bc05-1e3c41e059e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Flow 'volume_create_manager' (3ac480ea-2495-4f4a-85b1-8eff429b9d1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-2d9341f0-3642-42ad-b686-6b48abba310f req-d93d4629-9cd1-469a-bfa4-7fdbf9e50306 tempest-VolumesGetTestJSON-1414594021 None] Created volume successfully. Apr 15 10:06:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Acquiring lock "cinder-2997d7bb-1a6e-4177-bffb-b793405e690f-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Lock "cinder-2997d7bb-1a6e-4177-bffb-b793405e690f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Acquiring lock "cinder-quobyte-2997d7bb-1a6e-4177-bffb-b793405e690f" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Lock "cinder-quobyte-2997d7bb-1a6e-4177-bffb-b793405e690f" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:09 devstack sudo[83932]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:09 devstack cinder-volume[83167]: INFO oslo.privsep.daemon [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxig5wydw/privsep.sock'] Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147 1073741824" returned: 0 in 0.864s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:09 devstack sudo[83938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxig5wydw/privsep.sock Apr 15 10:06:09 devstack sudo[83938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:09 devstack sudo[83940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147 Apr 15 10:06:09 devstack sudo[83940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 15 10:06:09 devstack sudo[83940]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147" returned: 0 in 0.455s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.956s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] Creating offline snapshot a9e12472-148e-47e4-b3fc-73cbdf203d17 of volume 3e672bf9-3e45-44ca-a13c-502a2baf99d4 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf16555-9bdf-4fe6-a796-824492f269e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910a0e13-5678-4cee-929a-7511ebe1d147', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5018e854-c2c8-42ba-923b-e81db8de5c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:09 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Volume volume-910a0e13-5678-4cee-929a-7511ebe1d147 (910a0e13-5678-4cee-929a-7511ebe1d147): created successfully Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5018e854-c2c8-42ba-923b-e81db8de5c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Flow 'volume_create_manager' (e54e9628-9f00-438a-91cd-eae853f52a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-01b4d44a-77f7-4500-8b2b-58c52d2cf603 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Created volume successfully. Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 10:06:09 devstack cinder-volume[83167]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 15 10:06:10 devstack sudo[83938]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:10 devstack cinder-volume[83167]: INFO oslo.privsep.daemon [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Spawned new privsep daemon via rootwrap Apr 15 10:06:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Accepted privsep connection to /tmp/tmpxig5wydw/privsep.sock {{(pid=83167) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 15 10:06:10 devstack cinder-volume[83167]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 15 10:06:10 devstack cinder-volume[83167]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 15 10:06:10 devstack cinder-volume[83167]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 15 10:06:10 devstack cinder-volume[83167]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83946 Apr 15 10:06:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e3adc7-0009-449e-8d39-1dc2d648e978]: (2,) {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:10 devstack cinder-volume[83167]: WARNING oslo_privsep.priv_context [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] privsep daemon already running Apr 15 10:06:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f681c171-0684-438d-a55d-19af87fb27df]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2997d7bb-1a6e-4177-bffb-b793405e690f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[477cfec3-3350-4b46-9b2c-b8bf0b6a1b57]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:10 devstack sudo[83949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2997d7bb-1a6e-4177-bffb-b793405e690f Apr 15 10:06:10 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:10 devstack sudo[83950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 Apr 15 10:06:10 devstack sudo[83950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:10 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2997d7bb-1a6e-4177-bffb-b793405e690f" returned: 0 in 0.530s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2997d7bb-1a6e-4177-bffb-b793405e690f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:11 devstack sudo[83958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2997d7bb-1a6e-4177-bffb-b793405e690f Apr 15 10:06:11 devstack sudo[83958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:11 devstack sudo[83950]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4" returned: 0 in 0.623s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:11 devstack sudo[83961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 1G Apr 15 10:06:11 devstack sudo[83961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:11 devstack sudo[83958]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2997d7bb-1a6e-4177-bffb-b793405e690f" returned: 0 in 0.593s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Lock "cinder-quobyte-2997d7bb-1a6e-4177-bffb-b793405e690f" released by "delete_volume" :: held 2.480s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:11 devstack cinder-volume[83167]: WARNING cinder.quota [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:06:11 devstack cinder-volume[83167]: WARNING cinder.quota [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:06:11 devstack cinder-volume[83167]: DEBUG cinder.quota [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Created reservations ['31a56a00-c30a-4d18-a3cd-2e856d96bb81', 'd591699c-7213-48d6-b671-3333d94d1b7b', '695b53bd-aef2-4d93-a916-1b2787f13875', 'e785d13b-d1a3-4977-9db6-8b3ec1e391b8'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:11 devstack sudo[83971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:06:11 devstack sudo[83971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:12 devstack sudo[83961]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 1G" returned: 0 in 0.954s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:12 devstack sudo[83973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 Apr 15 10:06:12 devstack sudo[83973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:12 devstack sudo[83971]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.501s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:12 devstack cinder-volume[83167]: DEBUG cinder.manager [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:12 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Deleted volume successfully. Apr 15 10:06:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-4f628037-d7ee-4b59-b3cd-7cb47c3f52f4 req-db66f7a4-a815-4346-89eb-587674b23d1d tempest-VolumesGetTestJSON-1414594021 None] Lock "cinder-2997d7bb-1a6e-4177-bffb-b793405e690f-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:12 devstack sudo[83973]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17" returned: 0 in 0.528s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:12 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 is being set with open permissions: ugo+rw Apr 15 10:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:12 devstack sudo[83980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 Apr 15 10:06:12 devstack sudo[83980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:13 devstack cinder-volume[83167]: WARNING py.warnings [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-6c0beca5-515f-4429-96c3-fcb6d982d8d8 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 15 10:06:13 devstack cinder-volume[83167]: .first() Apr 15 10:06:13 devstack cinder-volume[83167]: Apr 15 10:06:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-6c0beca5-515f-4429-96c3-fcb6d982d8d8 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:13 devstack sudo[83980]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17" returned: 0 in 1.076s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:13 devstack sudo[83995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.info Apr 15 10:06:13 devstack sudo[83995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:14 devstack sudo[83995]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.info" returned: 0 in 0.562s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:14 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.info is being set with open permissions: ugo+rw Apr 15 10:06:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:14 devstack sudo[83998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.info Apr 15 10:06:14 devstack sudo[83998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:14 devstack sudo[83998]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.info" returned: 0 in 0.591s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.236s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-6c0beca5-515f-4429-96c3-fcb6d982d8d8 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.439s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-36fdc442-e859-4382-bcfe-59fa1e1339ae req-24204e4e-95bf-4e3d-8fa7-f8600778aa6b tempest-VolumesSnapshotsTestJSON-157023151 None] Create snapshot completed successfully Apr 15 10:06:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a989adc4-cc96-4982-9bb3-cbf9ae51a059]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-6c0beca5-515f-4429-96c3-fcb6d982d8d8 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:15 devstack sudo[84001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147 Apr 15 10:06:15 devstack sudo[84001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:15 devstack sudo[84001]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-6c0beca5-515f-4429-96c3-fcb6d982d8d8 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147" returned: 0 in 0.619s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-6c0beca5-515f-4429-96c3-fcb6d982d8d8 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.642s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-198fa48f-c596-49f2-b8d2-a572f1e13502 tempest-GroupSnapshotsV319Test-1942583497 None] Group tempest-GroupSnapshotsV319Test-Group-878583323: creating Apr 15 10:06:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Acquiring lock "cinder-a9e12472-148e-47e4-b3fc-73cbdf203d17-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "cinder-a9e12472-148e-47e4-b3fc-73cbdf203d17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Acquiring lock "cinder-quobyte-3e672bf9-3e45-44ca-a13c-502a2baf99d4" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-6c0beca5-515f-4429-96c3-fcb6d982d8d8 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b', 'name': 'volume-910a0e13-5678-4cee-929a-7511ebe1d147', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '098e1148-fd83-46a0-a0f7-25017e95cf46', 'enforce_multipath': True} {{(pid=83167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 10:06:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "cinder-quobyte-3e672bf9-3e45-44ca-a13c-502a2baf99d4" acquired by "delete_snapshot" :: waited 0.054s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Acquiring lock "cinder-quobyte-a9e12472-148e-47e4-b3fc-73cbdf203d17" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-198fa48f-c596-49f2-b8d2-a572f1e13502 tempest-GroupSnapshotsV319Test-1942583497 None] Group tempest-GroupSnapshotsV319Test-Group-878583323: created successfully Apr 15 10:06:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-198fa48f-c596-49f2-b8d2-a572f1e13502 tempest-GroupSnapshotsV319Test-1942583497 None] Create group completed successfully. Apr 15 10:06:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "cinder-quobyte-a9e12472-148e-47e4-b3fc-73cbdf203d17" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Deleting offline snapshot a9e12472-148e-47e4-b3fc-73cbdf203d17 of volume 3e672bf9-3e45-44ca-a13c-502a2baf99d4 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:06:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] snapshot_file for this snap is: volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:06:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba59e8cf-ab9d-4e47-99c4-33ab9c009642]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-cf39e8f6-f112-4656-aafd-bd9e3d51a9d8 req-6c0beca5-515f-4429-96c3-fcb6d982d8d8 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] attachment_update completed successfully. Apr 15 10:06:15 devstack sudo[84009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 Apr 15 10:06:15 devstack sudo[84009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:16 devstack sudo[84009]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17" returned: 0 in 0.577s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacc4ae4-c49f-4ffe-93f7-4f72b1c3b3a9]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:16 devstack sudo[84017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 Apr 15 10:06:16 devstack sudo[84017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Flow 'volume_create_manager' (0fcaf0cc-4b60-4464-967f-9401edd49804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd671d1e-9b07-4658-992c-ba2d81b26b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd671d1e-9b07-4658-992c-ba2d81b26b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-231528905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57911927-06ea-4ff0-8fa6-e552c5c4e02f,host='devstack@QuobyteHD#QuobyteHD',id=7a2cd023-673e-4573-9422-b3a9a2f6315a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85ad3c1d6fd4f3dbd4c89890719aef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:17Z,use_quota=True,user_id='7d01d557d7b642d58e982f6eab85f2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22d81d0b-a591-4e9c-b5c3-59b6ab6be096),volume_type_id=22d81d0b-a591-4e9c-b5c3-59b6ab6be096)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4652b5cf-0adf-4a5b-b499-b762ae0df41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4652b5cf-0adf-4a5b-b499-b762ae0df41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5d003c-81a2-4162-9862-c48b219489e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5d003c-81a2-4162-9862-c48b219489e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2cd023-673e-4573-9422-b3a9a2f6315a', 'volume_name': 'volume-7a2cd023-673e-4573-9422-b3a9a2f6315a', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19782c7e-a7ec-4521-aa7e-b810c4164462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19782c7e-a7ec-4521-aa7e-b810c4164462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6375e1-b81d-4d9c-92b7-f20678b3a8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:16 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Volume 7a2cd023-673e-4573-9422-b3a9a2f6315a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2cd023-673e-4573-9422-b3a9a2f6315a', 'volume_size': 1} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57911927-06ea-4ff0-8fa6-e552c5c4e02f,created_at=2026-04-15T08:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-231528905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57911927-06ea-4ff0-8fa6-e552c5c4e02f,host='devstack@QuobyteHD#QuobyteHD',id=7a2cd023-673e-4573-9422-b3a9a2f6315a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85ad3c1d6fd4f3dbd4c89890719aef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:17Z,use_quota=True,user_id='7d01d557d7b642d58e982f6eab85f2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22d81d0b-a591-4e9c-b5c3-59b6ab6be096),volume_type_id=22d81d0b-a591-4e9c-b5c3-59b6ab6be096)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Creating volume 7a2cd023-673e-4573-9422-b3a9a2f6315a {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:06:17 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:06:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:17 devstack sudo[84028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a 1073741824 Apr 15 10:06:17 devstack sudo[84028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:17 devstack sudo[84017]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4" returned: 0 in 0.682s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:17 devstack sudo[84031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 Apr 15 10:06:17 devstack sudo[84031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:17 devstack sudo[84028]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a 1073741824" returned: 0 in 0.603s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:17 devstack sudo[84031]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17" returned: 0 in 0.576s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:17 devstack sudo[84042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17 Apr 15 10:06:17 devstack sudo[84042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:17 devstack sudo[84044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a Apr 15 10:06:17 devstack sudo[84044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:18 devstack sudo[84042]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4.a9e12472-148e-47e4-b3fc-73cbdf203d17" returned: 0 in 0.504s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:18 devstack sudo[84044]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a" returned: 0 in 0.508s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "cinder-quobyte-a9e12472-148e-47e4-b3fc-73cbdf203d17" released by "_delete_snapshot" :: held 2.469s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6375e1-b81d-4d9c-92b7-f20678b3a8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2cd023-673e-4573-9422-b3a9a2f6315a', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630d3ae2-581d-43b2-a613-67cd2bca7811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "cinder-quobyte-3e672bf9-3e45-44ca-a13c-502a2baf99d4" released by "delete_snapshot" :: held 2.522s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:18 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Volume volume-7a2cd023-673e-4573-9422-b3a9a2f6315a (7a2cd023-673e-4573-9422-b3a9a2f6315a): created successfully Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630d3ae2-581d-43b2-a613-67cd2bca7811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Flow 'volume_create_manager' (0fcaf0cc-4b60-4464-967f-9401edd49804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d01242e3-b088-40c2-98f4-f642a7b686f8 tempest-GroupSnapshotsV319Test-1942583497 None] Created volume successfully. Apr 15 10:06:18 devstack cinder-volume[83167]: WARNING cinder.quota [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG cinder.quota [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Created reservations ['091e693e-6108-401b-8ed0-af128d9e44b3', 'aa63c073-2f11-45bf-bc29-d3598bcf8c38', 'a88b1a6a-e08d-4c26-a8b6-1f23947fc020', '98861b99-21b0-482e-be65-3350260f5593'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Delete snapshot completed successfully. Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-236a8833-f9a6-4fdb-9058-f29740e76fb1 req-5fb53bbb-29b8-4243-b89a-67c3a4738627 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "cinder-a9e12472-148e-47e4-b3fc-73cbdf203d17-delete_snapshot" released by "delete_snapshot" :: held 2.673s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Acquiring lock "cinder-3e672bf9-3e45-44ca-a13c-502a2baf99d4-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "cinder-3e672bf9-3e45-44ca-a13c-502a2baf99d4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Acquiring lock "cinder-quobyte-3e672bf9-3e45-44ca-a13c-502a2baf99d4" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "cinder-quobyte-3e672bf9-3e45-44ca-a13c-502a2baf99d4" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[496ba2e1-e167-4e04-8cad-0863ec9a9906]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:18 devstack sudo[84118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 Apr 15 10:06:18 devstack sudo[84118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] GroupSnapshot 720fc568-bd04-4fc3-a5b9-6151cef26cc2: creating. Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] Group snapshot 720fc568-bd04-4fc3-a5b9-6151cef26cc2: creating. {{(pid=83167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] Creating offline snapshot 57aabc59-e48f-4b2e-bf78-784d9626f149 of volume 7a2cd023-673e-4573-9422-b3a9a2f6315a {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[625b96e3-1020-43b0-85bc-583a33218a52]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:19 devstack sudo[84118]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:19 devstack sudo[84127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4 Apr 15 10:06:19 devstack sudo[84127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:19 devstack sudo[84126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a Apr 15 10:06:19 devstack sudo[84126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:19 devstack sudo[84127]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3e672bf9-3e45-44ca-a13c-502a2baf99d4" returned: 0 in 0.441s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "cinder-quobyte-3e672bf9-3e45-44ca-a13c-502a2baf99d4" released by "delete_volume" :: held 1.006s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG cinder.quota [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Created reservations ['82e8cfd3-03aa-45c8-b4ca-c2612b22b14c', 'a5d75b27-c582-403a-af26-c71fe383278a', '8d80f348-a5d4-4d35-b0f4-a13b19b75aff', 'ac2428c6-191f-4c29-8569-0809c52e6ae8'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:19 devstack sudo[84126]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a" returned: 0 in 0.523s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:19 devstack sudo[84134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 1G Apr 15 10:06:19 devstack sudo[84134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:19 devstack sudo[84136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:06:19 devstack sudo[84136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:20 devstack sudo[84136]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.472s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:20 devstack cinder-volume[83167]: DEBUG cinder.manager [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Deleted volume successfully. Apr 15 10:06:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-2e7c0101-23ac-43f8-a6b8-266927509c29 req-9fce7587-59af-4830-b5ad-7b36cf647425 tempest-VolumesSnapshotsTestJSON-157023151 None] Lock "cinder-3e672bf9-3e45-44ca-a13c-502a2baf99d4-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:20 devstack sudo[84134]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 1G" returned: 0 in 0.768s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2cd023-673e-4573-9422-b3a9a2f6315a -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:20 devstack sudo[84473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2cd023-673e-4573-9422-b3a9a2f6315a -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 Apr 15 10:06:20 devstack sudo[84473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:21 devstack sudo[84473]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2cd023-673e-4573-9422-b3a9a2f6315a -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149" returned: 0 in 0.732s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:21 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:06:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:21 devstack sudo[84487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 Apr 15 10:06:21 devstack sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:22 devstack sudo[84487]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149" returned: 0 in 0.590s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:22 devstack sudo[84491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.info Apr 15 10:06:22 devstack sudo[84491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:22 devstack sudo[84491]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.info" returned: 0 in 0.653s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:22 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:22 devstack sudo[84510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.info Apr 15 10:06:22 devstack sudo[84510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:23 devstack sudo[84510]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.info" returned: 0 in 0.577s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.923s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-efbbd183-db30-4492-88df-6e342c785a86 tempest-GroupSnapshotsV319Test-1942583497 None] group_snapshot 720fc568-bd04-4fc3-a5b9-6151cef26cc2: created successfully Apr 15 10:06:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] group_snapshot 720fc568-bd04-4fc3-a5b9-6151cef26cc2: deleting Apr 15 10:06:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] group_snapshot 720fc568-bd04-4fc3-a5b9-6151cef26cc2: deleting {{(pid=83167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 10:06:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Acquiring lock "cinder-quobyte-7a2cd023-673e-4573-9422-b3a9a2f6315a" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "cinder-quobyte-7a2cd023-673e-4573-9422-b3a9a2f6315a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Acquiring lock "cinder-quobyte-57aabc59-e48f-4b2e-bf78-784d9626f149" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "cinder-quobyte-57aabc59-e48f-4b2e-bf78-784d9626f149" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Deleting offline snapshot 57aabc59-e48f-4b2e-bf78-784d9626f149 of volume 7a2cd023-673e-4573-9422-b3a9a2f6315a {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:06:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] snapshot_file for this snap is: volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:06:24 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c370ca29-2d1b-4bbe-afc5-ccdd4ace1cb4]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:24 devstack sudo[84522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 Apr 15 10:06:24 devstack sudo[84522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c0be4fad-7ee2-4d5e-8fb4-8685505279a5 tempest-BackendsCapabilitiesAdminTestsJSON-1823755567 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6867942810059, 'free_capacity_gb': 1775.6867942810059, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83167) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 10:06:24 devstack sudo[84522]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149" returned: 0 in 0.589s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a2cd023-673e-4573-9422-b3a9a2f6315a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:06:24 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2057028c-0550-4dd5-bd0f-abbb29bf17e0]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:24 devstack sudo[84528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a Apr 15 10:06:24 devstack sudo[84528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5baa1d34-2d04-4ca2-b0d3-b44daab8373d tempest-BackendsCapabilitiesAdminTestsJSON-1823755567 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6867942810059, 'free_capacity_gb': 1775.6867942810059, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83167) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 10:06:25 devstack sudo[84528]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a" returned: 0 in 0.477s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:25 devstack sudo[84533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 Apr 15 10:06:25 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:25 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149" returned: 0 in 0.800s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:25 devstack sudo[84541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149 Apr 15 10:06:25 devstack sudo[84541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:26 devstack sudo[84541]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a.57aabc59-e48f-4b2e-bf78-784d9626f149" returned: 0 in 0.544s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "cinder-quobyte-57aabc59-e48f-4b2e-bf78-784d9626f149" released by "_delete_snapshot" :: held 2.487s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "cinder-quobyte-7a2cd023-673e-4573-9422-b3a9a2f6315a" released by "delete_snapshot" :: held 2.503s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:26 devstack cinder-volume[83167]: WARNING cinder.quota [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-705679170 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-705679170, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:06:26 devstack cinder-volume[83167]: WARNING cinder.quota [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-705679170 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-705679170, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:06:26 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] Created reservations ['387cdfed-4a23-41b6-96dd-45515aa67d58', 'd3b6bba6-c45b-40c5-8766-167a32618bb4', '585c4b76-9c90-41ee-9bac-6a94fe28b4c1', '4460b257-df2f-4abd-81ca-ccbdc8f707f8'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4c4c0280-4cf0-4c35-8a98-bccbe7f576e9 tempest-GroupSnapshotsV319Test-1942583497 None] group_snapshot 720fc568-bd04-4fc3-a5b9-6151cef26cc2: deleted successfully Apr 15 10:06:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Acquiring lock "cinder-quobyte-7a2cd023-673e-4573-9422-b3a9a2f6315a" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "cinder-quobyte-7a2cd023-673e-4573-9422-b3a9a2f6315a" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:27 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[da22f46a-98b4-4884-afc0-ad61d6bd1948]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:27 devstack sudo[84573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a Apr 15 10:06:27 devstack sudo[84573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:28 devstack sudo[84573]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a" returned: 0 in 0.857s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:28 devstack sudo[84600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a Apr 15 10:06:28 devstack sudo[84600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:29 devstack sudo[84600]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7a2cd023-673e-4573-9422-b3a9a2f6315a" returned: 0 in 0.793s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "cinder-quobyte-7a2cd023-673e-4573-9422-b3a9a2f6315a" released by "delete_volume" :: held 1.708s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:29 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Created reservations ['13d63496-dc9c-48d6-afb5-f47e2e34276d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:29 devstack cinder-volume[83167]: WARNING cinder.quota [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-705679170 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-705679170, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:06:29 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Created reservations ['4eca68bf-2dfe-47e1-8556-f4cee255df53', 'f2ccaa1c-328e-4ddd-868e-7284a12682df', '7fef1886-fc4d-48dd-9aca-7d33155884e4', '42e2584e-3532-4712-bdbf-c5bf9a31742f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:29 devstack sudo[84608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:06:29 devstack sudo[84608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1ff587db-6673-4c53-9f09-69ec3f62c444 tempest-GroupsV314Test-757787092 None] Group tempest-GroupsV314Test-Group-772278147: creating Apr 15 10:06:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1ff587db-6673-4c53-9f09-69ec3f62c444 tempest-GroupsV314Test-757787092 None] Group tempest-GroupsV314Test-Group-772278147: created successfully Apr 15 10:06:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1ff587db-6673-4c53-9f09-69ec3f62c444 tempest-GroupsV314Test-757787092 None] Create group completed successfully. Apr 15 10:06:30 devstack sudo[84608]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.721s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ab2ec2a5-44ac-44b7-85f1-eadd8d5cc106 tempest-GroupSnapshotsV319Test-1942583497 None] Delete group completed successfully. Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Flow 'volume_create_manager' (3409d93f-7d9b-403a-ad6f-d3e4d587a61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9827b3c-4648-45dc-ac64-ad4c12c6d735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9827b3c-4648-45dc-ac64-ad4c12c6d735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1191138064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff536ea-0ec0-4e03-807f-7ee6b09859da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22efbaa65c1144e0af0bb406b47924f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:30Z,use_quota=True,user_id='ccaa8de67e2f4f2485c1c2f6e13b898c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94075032-a503-4fdf-abe3-5b3aa46f8137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94075032-a503-4fdf-abe3-5b3aa46f8137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7eb804-c0e2-4861-9715-efaa3187610d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7eb804-c0e2-4861-9715-efaa3187610d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff536ea-0ec0-4e03-807f-7ee6b09859da', 'volume_name': 'volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0680b87f-9f73-4659-b719-8153ab30db3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0680b87f-9f73-4659-b719-8153ab30db3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28205c7a-d8dc-42f7-bb7c-9648f58ef28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:30 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Volume 7ff536ea-0ec0-4e03-807f-7ee6b09859da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da', 'volume_size': 1} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1191138064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff536ea-0ec0-4e03-807f-7ee6b09859da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22efbaa65c1144e0af0bb406b47924f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:30Z,use_quota=True,user_id='ccaa8de67e2f4f2485c1c2f6e13b898c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Creating volume 7ff536ea-0ec0-4e03-807f-7ee6b09859da {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:06:30 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:06:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:30 devstack sudo[84628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da 1073741824 Apr 15 10:06:30 devstack sudo[84628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:31 devstack sudo[84628]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da 1073741824" returned: 0 in 0.740s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:31 devstack sudo[84634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da Apr 15 10:06:31 devstack sudo[84634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Flow 'volume_create_manager' (820342c6-fc66-4552-943a-031dbbf52ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62db0fe-82df-4c07-884a-6ff8d4c2457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62db0fe-82df-4c07-884a-6ff8d4c2457e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1109171001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5bfcb919-9269-4334-80ad-c8b9e8b31b35,host='devstack@QuobyteHD#QuobyteHD',id=2b9e45c3-5e58-4207-acf1-860507be5f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8f0f5c3a9d48caaeae9ebe0512494b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:31Z,use_quota=True,user_id='a0fc1b2b32a742ba99c36ff84174af77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47ce6c67-406c-4e13-8d1a-11cd9f756f04),volume_type_id=47ce6c67-406c-4e13-8d1a-11cd9f756f04)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3cc414-d7cb-4458-a285-654be5e5f187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3cc414-d7cb-4458-a285-654be5e5f187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48222f3c-c185-4c99-b1e1-3cd1f43abd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48222f3c-c185-4c99-b1e1-3cd1f43abd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b9e45c3-5e58-4207-acf1-860507be5f56', 'volume_name': 'volume-2b9e45c3-5e58-4207-acf1-860507be5f56', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e502df29-ad8c-48ed-bdc9-a1dff5a2608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e502df29-ad8c-48ed-bdc9-a1dff5a2608b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdf6806-d2a5-407f-9592-c01c6ae9f1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:31 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Volume 2b9e45c3-5e58-4207-acf1-860507be5f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b9e45c3-5e58-4207-acf1-860507be5f56', 'volume_size': 1} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:31 devstack sudo[84634]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da" returned: 0 in 0.545s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5bfcb919-9269-4334-80ad-c8b9e8b31b35,created_at=2026-04-15T08:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1109171001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5bfcb919-9269-4334-80ad-c8b9e8b31b35,host='devstack@QuobyteHD#QuobyteHD',id=2b9e45c3-5e58-4207-acf1-860507be5f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8f0f5c3a9d48caaeae9ebe0512494b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:31Z,use_quota=True,user_id='a0fc1b2b32a742ba99c36ff84174af77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47ce6c67-406c-4e13-8d1a-11cd9f756f04),volume_type_id=47ce6c67-406c-4e13-8d1a-11cd9f756f04)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Creating volume 2b9e45c3-5e58-4207-acf1-860507be5f56 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:06:31 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28205c7a-d8dc-42f7-bb7c-9648f58ef28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:31 devstack sudo[84638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 1073741824 Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8365bb35-acf2-4394-9e5a-9e88aebd1d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:31 devstack sudo[84638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:31 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Volume volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da (7ff536ea-0ec0-4e03-807f-7ee6b09859da): created successfully Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8365bb35-acf2-4394-9e5a-9e88aebd1d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Flow 'volume_create_manager' (3409d93f-7d9b-403a-ad6f-d3e4d587a61a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a7235825-c4c5-4698-9c08-e596bd5bec03 tempest-VolumesAdminNegativeTest-1936422913 None] Created volume successfully. Apr 15 10:06:32 devstack sudo[84638]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 1073741824" returned: 0 in 0.798s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:32 devstack sudo[84656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 Apr 15 10:06:32 devstack sudo[84656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Acquiring lock "cinder-7ff536ea-0ec0-4e03-807f-7ee6b09859da-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Lock "cinder-7ff536ea-0ec0-4e03-807f-7ee6b09859da-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Acquiring lock "cinder-quobyte-7ff536ea-0ec0-4e03-807f-7ee6b09859da" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Lock "cinder-quobyte-7ff536ea-0ec0-4e03-807f-7ee6b09859da" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:33 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1199a36-225c-4f49-8afb-2fa44c75f9bb]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:33 devstack sudo[84690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da Apr 15 10:06:33 devstack sudo[84690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:33 devstack sudo[84656]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56" returned: 0 in 0.751s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:06:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdf6806-d2a5-407f-9592-c01c6ae9f1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b9e45c3-5e58-4207-acf1-860507be5f56', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a12cf69-4bf3-4674-ad09-14884d54cecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:33 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Volume volume-2b9e45c3-5e58-4207-acf1-860507be5f56 (2b9e45c3-5e58-4207-acf1-860507be5f56): created successfully Apr 15 10:06:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a12cf69-4bf3-4674-ad09-14884d54cecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Flow 'volume_create_manager' (820342c6-fc66-4552-943a-031dbbf52ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-943372f2-1932-47e4-9c6d-fabe7b529ab4 tempest-GroupsV314Test-757787092 None] Created volume successfully. Apr 15 10:06:33 devstack sudo[84690]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da" returned: 0 in 0.755s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:33 devstack sudo[84698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da Apr 15 10:06:33 devstack sudo[84698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:34 devstack sudo[84698]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ff536ea-0ec0-4e03-807f-7ee6b09859da" returned: 0 in 0.564s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Lock "cinder-quobyte-7ff536ea-0ec0-4e03-807f-7ee6b09859da" released by "delete_volume" :: held 1.415s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:34 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Created reservations ['0ad75e42-c997-4dd9-b0a1-ad4aac21511c', '6e5659f1-8e45-4c3c-8ea0-5bb43379d6ce', '756ca9b5-6bf5-40ea-ad5e-fa4977b0fb17', 'fbd5301e-ee57-4382-90ac-6c3817dc898e'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:34 devstack sudo[84729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:06:34 devstack sudo[84729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:35 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Cloning volume 2b9e45c3-5e58-4207-acf1-860507be5f56 to volume 22ff763f-0ea7-4995-952b-ddcd8a75c45b Apr 15 10:06:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Creating offline snapshot 5234e94c-a642-4a73-bf5d-3c5457070dbb of volume 2b9e45c3-5e58-4207-acf1-860507be5f56 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:06:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae1ddb6-82bd-408b-97e2-2c4495e075c4]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:35 devstack sudo[84733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 Apr 15 10:06:35 devstack sudo[84733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:36 devstack sudo[84733]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56" returned: 0 in 0.948s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:36 devstack sudo[84740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb 1G Apr 15 10:06:36 devstack sudo[84740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:36 devstack sudo[84729]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.594s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:36 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:36 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Deleted volume successfully. Apr 15 10:06:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-08dd8b6d-b0ae-4dea-b52e-b56d7cb26c23 tempest-VolumesAdminNegativeTest-1936422913 None] Lock "cinder-7ff536ea-0ec0-4e03-807f-7ee6b09859da-delete_volume" released by "delete_volume" :: held 3.426s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:37 devstack sudo[84740]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb 1G" returned: 0 in 0.974s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b9e45c3-5e58-4207-acf1-860507be5f56 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:37 devstack sudo[84770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b9e45c3-5e58-4207-acf1-860507be5f56 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb Apr 15 10:06:37 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:37 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:06:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:37 devstack sudo[84774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:06:37 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:38 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b9e45c3-5e58-4207-acf1-860507be5f56 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb" returned: 0 in 0.790s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:38 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:38 devstack sudo[84803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb Apr 15 10:06:38 devstack sudo[84803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:38 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.752s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:38 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:38 devstack sudo[84803]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb" returned: 0 in 0.686s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:38 devstack sudo[84808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.info Apr 15 10:06:38 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:39 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.info" returned: 0 in 0.514s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:39 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:06:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:39 devstack sudo[84812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.info Apr 15 10:06:39 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:39 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.info" returned: 0 in 0.613s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Acquiring lock "cinder-quobyte-22ff763f-0ea7-4995-952b-ddcd8a75c45b" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Lock "cinder-quobyte-22ff763f-0ea7-4995-952b-ddcd8a75c45b" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] snapshot: 5234e94c-a642-4a73-bf5d-3c5457070dbb, volume: 22ff763f-0ea7-4995-952b-ddcd8a75c45b, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:06:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:39 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ae7703-d30f-4d84-91cc-d3156c02a5e0]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:40 devstack sudo[84843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb Apr 15 10:06:40 devstack sudo[84843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Flow 'volume_create_manager' (b22aac9f-d3ac-4898-98c7-ac9e45abe0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:40 devstack sudo[84843]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe6f2b7-0237-412f-b954-ef4017430756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe6f2b7-0237-412f-b954-ef4017430756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1778520056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1be057-c626-49eb-9914-e055b9066be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='354eda2c75484b57ba5d02e81723ccef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:41Z,use_quota=True,user_id='2f9218d1c5044fd18c41cb5aa4488920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b69817-e188-4adf-8ed8-7a210409be83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b69817-e188-4adf-8ed8-7a210409be83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6423e06b-4b01-4b3e-9a58-680ea04efd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6423e06b-4b01-4b3e-9a58-680ea04efd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1be057-c626-49eb-9914-e055b9066be4', 'volume_name': 'volume-7b1be057-c626-49eb-9914-e055b9066be4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad3299f-0a62-4c13-b575-4ca1a42f4f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad3299f-0a62-4c13-b575-4ca1a42f4f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ef44ca-a520-4c32-bba6-a2fe5000f858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:40 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Volume 7b1be057-c626-49eb-9914-e055b9066be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1be057-c626-49eb-9914-e055b9066be4', 'volume_size': 1} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb" returned: 0 in 0.737s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b9e45c3-5e58-4207-acf1-860507be5f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] will copy from snapshot at /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a738b33-53a0-4d74-a04b-940ca5207202]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:40 devstack sudo[84871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 Apr 15 10:06:40 devstack sudo[84871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:41 devstack sudo[84871]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56" returned: 0 in 0.549s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:41 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Path /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:06:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:41 devstack sudo[84876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b Apr 15 10:06:41 devstack sudo[84876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:43 devstack sudo[84876]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b" returned: 0 in 2.480s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:43 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30c9528-e1ee-4bbc-861b-f5449e888ce8]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:43 devstack sudo[84913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 Apr 15 10:06:43 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:44 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56" returned: 0 in 0.650s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:44 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56, size 1024.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:06:44 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Converted 1024.00 MB image at 412.40 MB/s Apr 15 10:06:44 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:06:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:44 devstack sudo[84919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b Apr 15 10:06:44 devstack sudo[84919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:44 devstack sudo[84919]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b" returned: 0 in 0.449s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Lock "cinder-quobyte-22ff763f-0ea7-4995-952b-ddcd8a75c45b" released by "_copy_volume_from_snapshot" :: held 4.937s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Acquiring lock "cinder-quobyte-5234e94c-a642-4a73-bf5d-3c5457070dbb" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Lock "cinder-quobyte-5234e94c-a642-4a73-bf5d-3c5457070dbb" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Deleting offline snapshot 5234e94c-a642-4a73-bf5d-3c5457070dbb of volume 2b9e45c3-5e58-4207-acf1-860507be5f56 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:06:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] snapshot_file for this snap is: volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:06:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[72994ae6-1495-4ee5-be41-2fed2de66f78]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:44 devstack sudo[84924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb Apr 15 10:06:44 devstack sudo[84924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:45 devstack sudo[84924]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b9e45c3-5e58-4207-acf1-860507be5f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:06:45 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80f3532-6b7e-4965-8319-c3afecc05ce3]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:45 devstack sudo[84929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 Apr 15 10:06:45 devstack sudo[84929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:45 devstack sudo[84929]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:45 devstack sudo[84934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb Apr 15 10:06:45 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:46 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb" returned: 0 in 0.530s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:46 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb Apr 15 10:06:46 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:46 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56.5234e94c-a642-4a73-bf5d-3c5457070dbb" returned: 0 in 0.441s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Lock "cinder-quobyte-5234e94c-a642-4a73-bf5d-3c5457070dbb" released by "_delete_snapshot" :: held 2.077s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.740s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.294s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1778520056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1be057-c626-49eb-9914-e055b9066be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='354eda2c75484b57ba5d02e81723ccef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:41Z,use_quota=True,user_id='2f9218d1c5044fd18c41cb5aa4488920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Creating volume 7b1be057-c626-49eb-9914-e055b9066be4 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:06:46 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b1be057-c626-49eb-9914-e055b9066be4 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:47 devstack sudo[84945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b1be057-c626-49eb-9914-e055b9066be4 1073741824 Apr 15 10:06:47 devstack sudo[84945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:47 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4998c203-b2f7-4f9c-97a1-063f46a63ffb tempest-GroupsV314Test-757787092 None] Create group from source-group-5bfcb919-9269-4334-80ad-c8b9e8b31b35 completed successfully. Apr 15 10:06:47 devstack sudo[84945]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b1be057-c626-49eb-9914-e055b9066be4 1073741824" returned: 0 in 0.680s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b1be057-c626-49eb-9914-e055b9066be4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:47 devstack sudo[84951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b1be057-c626-49eb-9914-e055b9066be4 Apr 15 10:06:47 devstack sudo[84951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Acquiring lock "cinder-quobyte-22ff763f-0ea7-4995-952b-ddcd8a75c45b" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Lock "cinder-quobyte-22ff763f-0ea7-4995-952b-ddcd8a75c45b" acquired by "delete_volume" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:47 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed324aa-4de0-40ca-b4ba-61bd4a3a2998]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:48 devstack sudo[84953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b Apr 15 10:06:48 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:48 devstack sudo[84951]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b1be057-c626-49eb-9914-e055b9066be4" returned: 0 in 0.630s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:06:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ef44ca-a520-4c32-bba6-a2fe5000f858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1be057-c626-49eb-9914-e055b9066be4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec73ca9d-e5f7-4373-b1c0-9073bf3a7389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:48 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Volume volume-7b1be057-c626-49eb-9914-e055b9066be4 (7b1be057-c626-49eb-9914-e055b9066be4): created successfully Apr 15 10:06:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec73ca9d-e5f7-4373-b1c0-9073bf3a7389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Flow 'volume_create_manager' (b22aac9f-d3ac-4898-98c7-ac9e45abe0f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-df621eff-9212-45d4-96b7-f2849f9f28e4 tempest-VolumeQuotasAdminTestJSON-91210556 None] Created volume successfully. Apr 15 10:06:48 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b" returned: 0 in 0.735s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:48 devstack sudo[84959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b Apr 15 10:06:48 devstack sudo[84959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Acquiring lock "cinder-7b1be057-c626-49eb-9914-e055b9066be4-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:49 devstack sudo[84959]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22ff763f-0ea7-4995-952b-ddcd8a75c45b" returned: 0 in 0.537s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Lock "cinder-quobyte-22ff763f-0ea7-4995-952b-ddcd8a75c45b" released by "delete_volume" :: held 1.303s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "cinder-7b1be057-c626-49eb-9914-e055b9066be4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Acquiring lock "cinder-quobyte-7b1be057-c626-49eb-9914-e055b9066be4" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "cinder-quobyte-7b1be057-c626-49eb-9914-e055b9066be4" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[546f92a7-1abb-44cd-8dd7-36364dc5cc2f]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b1be057-c626-49eb-9914-e055b9066be4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Created reservations ['3e657348-9f68-470a-b515-a5c99f30dbd4'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:49 devstack cinder-volume[83167]: WARNING cinder.quota [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2076209267 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2076209267, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:06:49 devstack cinder-volume[83167]: WARNING cinder.quota [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2076209267 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2076209267, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Created reservations ['1f7bec7f-e6a0-42ee-a40e-e0df399c49b1', 'f5ec159f-a34e-44b8-a3dd-ccb99eb2f6e0', '669af41a-e362-4f09-aea7-fd2baa19e0fe', 'efef4f05-0fbc-4b71-bdce-134ae3ca397f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:49 devstack sudo[84974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b1be057-c626-49eb-9914-e055b9066be4 Apr 15 10:06:49 devstack sudo[84974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:49 devstack sudo[84982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:06:49 devstack sudo[84982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:49 devstack sudo[84974]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b1be057-c626-49eb-9914-e055b9066be4" returned: 0 in 0.657s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b1be057-c626-49eb-9914-e055b9066be4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:50 devstack sudo[84988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b1be057-c626-49eb-9914-e055b9066be4 Apr 15 10:06:50 devstack sudo[84988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:50 devstack sudo[84982]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.545s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:50 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-584169b8-3f56-4dc1-a2b7-c7c75322e97f tempest-GroupsV314Test-757787092 None] Delete group completed successfully. Apr 15 10:06:50 devstack sudo[84988]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b1be057-c626-49eb-9914-e055b9066be4" returned: 0 in 0.494s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "cinder-quobyte-7b1be057-c626-49eb-9914-e055b9066be4" released by "delete_volume" :: held 1.179s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Acquiring lock "cinder-quobyte-2b9e45c3-5e58-4207-acf1-860507be5f56" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Created reservations ['f9a86a0a-158d-47b0-be39-c01b31d2104a', '8f9eac0e-adf6-4c72-a71e-f8b5fe4a7c9b', 'cf53528c-0cb1-4ddd-a3ee-33a2588ffc46', '89e8e28d-621a-4538-a954-e4b8596b8d2b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Lock "cinder-quobyte-2b9e45c3-5e58-4207-acf1-860507be5f56" acquired by "delete_volume" :: waited 0.032s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c281bed1-c43d-48e8-ac9d-bbcd7259c6e3]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:50 devstack sudo[84992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 Apr 15 10:06:50 devstack sudo[84992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:50 devstack sudo[84993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:06:50 devstack sudo[84993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:51 devstack sudo[84993]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.513s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:51 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Deleted volume successfully. Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-21861608-25d2-4c21-a028-8c0271809762 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "cinder-7b1be057-c626-49eb-9914-e055b9066be4-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:51 devstack sudo[84992]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56" returned: 0 in 0.714s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:51 devstack sudo[85000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56 Apr 15 10:06:51 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Flow 'volume_create_manager' (e87b227e-1e25-4f4a-9ab4-1a9283fe71fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246b987c-197c-4129-a068-8e937790c81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246b987c-197c-4129-a068-8e937790c81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1075562572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d5b6e5-e4bb-4635-a6bd-dca64d28eda7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='354eda2c75484b57ba5d02e81723ccef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:52Z,use_quota=True,user_id='2f9218d1c5044fd18c41cb5aa4488920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:51 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f072bc-cffe-42b1-a0ad-83eb687c6226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f072bc-cffe-42b1-a0ad-83eb687c6226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab156fe-a100-4a5a-8562-07586aa2ebb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab156fe-a100-4a5a-8562-07586aa2ebb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d5b6e5-e4bb-4635-a6bd-dca64d28eda7', 'volume_name': 'volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea6cc47-a9d6-4b47-ab5d-ed4d9363f31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea6cc47-a9d6-4b47-ab5d-ed4d9363f31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f79c0ea-9dd7-4c08-b625-ef4394d17168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:51 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Volume 51d5b6e5-e4bb-4635-a6bd-dca64d28eda7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7', 'volume_size': 1} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1075562572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d5b6e5-e4bb-4635-a6bd-dca64d28eda7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='354eda2c75484b57ba5d02e81723ccef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:52Z,use_quota=True,user_id='2f9218d1c5044fd18c41cb5aa4488920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Creating volume 51d5b6e5-e4bb-4635-a6bd-dca64d28eda7 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:06:51 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9e45c3-5e58-4207-acf1-860507be5f56" returned: 0 in 0.622s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:51 devstack sudo[85004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7 1073741824 Apr 15 10:06:51 devstack sudo[85004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Lock "cinder-quobyte-2b9e45c3-5e58-4207-acf1-860507be5f56" released by "delete_volume" :: held 1.401s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:52 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Created reservations ['6d51a2b3-38e0-45ee-8749-3c8ceac1cdd2'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:52 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Created reservations ['0261e3ba-de8b-4f0a-a3b3-b401b25eb0e5', 'ff3f679c-f052-47f3-839f-accde131c115', 'c46edcbe-f011-4146-a045-b535e0dac4e8', 'a1598b6a-af97-4f30-9312-9a6bba7e81f8'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:52 devstack sudo[85009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:06:52 devstack sudo[85009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:52 devstack sudo[85004]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7 1073741824" returned: 0 in 0.681s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:52 devstack sudo[85009]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.516s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:52 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:52 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-314ca390-7ef3-4823-ae43-71deba5bb005 tempest-GroupsV314Test-757787092 None] Delete group completed successfully. Apr 15 10:06:52 devstack sudo[85016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7 Apr 15 10:06:52 devstack sudo[85016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:53 devstack sudo[85016]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7" returned: 0 in 0.460s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:06:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f79c0ea-9dd7-4c08-b625-ef4394d17168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8716a75-bc63-4c50-8900-1b21879abf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:53 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Volume volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7 (51d5b6e5-e4bb-4635-a6bd-dca64d28eda7): created successfully Apr 15 10:06:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8716a75-bc63-4c50-8900-1b21879abf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Flow 'volume_create_manager' (e87b227e-1e25-4f4a-9ab4-1a9283fe71fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:53 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5c47985f-6924-4157-8c76-526a02eb2a46 tempest-VolumeQuotasAdminTestJSON-91210556 None] Created volume successfully. Apr 15 10:06:54 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-903fcec8-9726-46dc-bf94-f37a8a725786 tempest-VolumeQuotasAdminTestJSON-803926157 None] Transfer volume completed successfully. Apr 15 10:06:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Acquiring lock "cinder-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Lock "cinder-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Acquiring lock "cinder-quobyte-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Lock "cinder-quobyte-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:55 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[293835f7-f0dd-4ab1-ab9b-b8a6405a7047]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:56 devstack sudo[85048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7 Apr 15 10:06:56 devstack sudo[85048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:56 devstack sudo[85048]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7" returned: 0 in 0.802s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:56 devstack sudo[85055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7 Apr 15 10:06:56 devstack sudo[85055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:57 devstack sudo[85055]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7" returned: 0 in 0.770s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Lock "cinder-quobyte-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7" released by "delete_volume" :: held 1.616s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:57 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=118,cinder:SELECT=113,cinder:INSERT=26,cinder:DELETE=6 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:06:57 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=94,cinder:UPDATE=104,cinder:DELETE=7,cinder:INSERT=25 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:06:57 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Created reservations ['13fa6804-500f-4e71-906c-3dec38b4e4e2', '996779fc-19fc-469f-9b5a-f480b9af2465', 'cfc1516c-e991-4dcc-9668-391f9d8a82e3', '5b0670ab-3180-4d8b-9200-43eefbbbdba1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:57 devstack sudo[85058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:06:57 devstack sudo[85058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-dbd8e25d-e3ab-465a-b3b5-8a6858dff488 tempest-GroupsV320Test-53342860 None] Group tempest-GroupsV320Test-Group-1205581178: creating Apr 15 10:06:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-dbd8e25d-e3ab-465a-b3b5-8a6858dff488 tempest-GroupsV320Test-53342860 None] Group tempest-GroupsV320Test-Group-1205581178: created successfully Apr 15 10:06:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-dbd8e25d-e3ab-465a-b3b5-8a6858dff488 tempest-GroupsV320Test-53342860 None] Create group completed successfully. Apr 15 10:06:58 devstack sudo[85058]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.580s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:58 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:58 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Deleted volume successfully. Apr 15 10:06:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2adab42f-d6b8-4329-bd81-33c58893be5e tempest-VolumeQuotasAdminTestJSON-534603568 None] Lock "cinder-51d5b6e5-e4bb-4635-a6bd-dca64d28eda7-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:59 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-5f950a1e-d895-4cc9-940c-30dc69b0a4db tempest-GroupsV320Test-53342860 None] Created reservations ['dbef9580-db50-4999-be32-e1a188a5b972'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f950a1e-d895-4cc9-940c-30dc69b0a4db tempest-GroupsV320Test-53342860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f950a1e-d895-4cc9-940c-30dc69b0a4db tempest-GroupsV320Test-53342860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5f950a1e-d895-4cc9-940c-30dc69b0a4db tempest-GroupsV320Test-53342860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5f950a1e-d895-4cc9-940c-30dc69b0a4db tempest-GroupsV320Test-53342860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f950a1e-d895-4cc9-940c-30dc69b0a4db tempest-GroupsV320Test-53342860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f950a1e-d895-4cc9-940c-30dc69b0a4db tempest-GroupsV320Test-53342860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:59 devstack sudo[85063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:06:59 devstack sudo[85063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:00 devstack sudo[85063]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f950a1e-d895-4cc9-940c-30dc69b0a4db tempest-GroupsV320Test-53342860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.575s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:00 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-5f950a1e-d895-4cc9-940c-30dc69b0a4db tempest-GroupsV320Test-53342860 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:07:00 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5f950a1e-d895-4cc9-940c-30dc69b0a4db tempest-GroupsV320Test-53342860 None] Delete group completed successfully. Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Flow 'volume_create_manager' (a12fbdbf-efa6-4f83-8bed-4f3c09f701dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d190e6f-6000-4b20-85e1-2d3472daf173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d190e6f-6000-4b20-85e1-2d3472daf173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1196256989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cefd90e-b58d-4f03-84c7-dfe2434dc0cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443663ae0c144e7ca4fd14fa58064846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:07Z,use_quota=True,user_id='8385d73ea2d842ffa649120c53194258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd751d65-b4af-44ed-9822-34291c2b91df),volume_type_id=bd751d65-b4af-44ed-9822-34291c2b91df)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a1667a-1cde-4754-8c9f-e6ae0686bcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a1667a-1cde-4754-8c9f-e6ae0686bcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41200d66-63ff-4f4f-8e26-1532c4e07e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41200d66-63ff-4f4f-8e26-1532c4e07e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cefd90e-b58d-4f03-84c7-dfe2434dc0cc', 'volume_name': 'volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a8ad33-cbf6-4bb5-96a7-7ea844937417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a8ad33-cbf6-4bb5-96a7-7ea844937417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22669a93-fa74-4e36-aa17-f6df8a2a9205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Volume 8cefd90e-b58d-4f03-84c7-dfe2434dc0cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc', 'volume_size': 1} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1196256989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cefd90e-b58d-4f03-84c7-dfe2434dc0cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443663ae0c144e7ca4fd14fa58064846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:07Z,use_quota=True,user_id='8385d73ea2d842ffa649120c53194258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd751d65-b4af-44ed-9822-34291c2b91df),volume_type_id=bd751d65-b4af-44ed-9822-34291c2b91df)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Creating volume 8cefd90e-b58d-4f03-84c7-dfe2434dc0cc {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:07:07 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:07:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:07 devstack sudo[85104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc 1073741824 Apr 15 10:07:07 devstack sudo[85104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:08 devstack sudo[85104]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc 1073741824" returned: 0 in 0.864s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:08 devstack sudo[85110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc Apr 15 10:07:08 devstack sudo[85110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:08 devstack sudo[85110]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc" returned: 0 in 0.538s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22669a93-fa74-4e36-aa17-f6df8a2a9205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0f5161-488a-4f3d-a10d-d1e13208b329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:08 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Volume volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc (8cefd90e-b58d-4f03-84c7-dfe2434dc0cc): created successfully Apr 15 10:07:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0f5161-488a-4f3d-a10d-d1e13208b329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Flow 'volume_create_manager' (a12fbdbf-efa6-4f83-8bed-4f3c09f701dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ac49a976-234e-4867-af0a-32145874f3e6 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Created volume successfully. Apr 15 10:07:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aba801ec-dad2-4675-afbf-0f33268ddd94 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aba801ec-dad2-4675-afbf-0f33268ddd94 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-aba801ec-dad2-4675-afbf-0f33268ddd94 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-aba801ec-dad2-4675-afbf-0f33268ddd94 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aba801ec-dad2-4675-afbf-0f33268ddd94 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aba801ec-dad2-4675-afbf-0f33268ddd94 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:09 devstack sudo[85113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:07:09 devstack sudo[85113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:10 devstack sudo[85113]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aba801ec-dad2-4675-afbf-0f33268ddd94 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.535s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:10 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-aba801ec-dad2-4675-afbf-0f33268ddd94 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:07:10 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-aba801ec-dad2-4675-afbf-0f33268ddd94 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Retype volume completed successfully. Apr 15 10:07:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Acquiring lock "cinder-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Lock "cinder-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Acquiring lock "cinder-quobyte-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Lock "cinder-quobyte-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:11 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c58b0f7-740f-4950-b05a-59e1dd48793c]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:11 devstack sudo[85117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc Apr 15 10:07:11 devstack sudo[85117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:12 devstack sudo[85117]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc" returned: 0 in 0.894s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:12 devstack sudo[85124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc Apr 15 10:07:12 devstack sudo[85124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:12 devstack sudo[85124]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc" returned: 0 in 0.570s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Lock "cinder-quobyte-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc" released by "delete_volume" :: held 1.512s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:12 devstack cinder-volume[83167]: WARNING cinder.quota [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:07:12 devstack cinder-volume[83167]: WARNING cinder.quota [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:07:12 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Created reservations ['1601c8e7-54b0-4a31-85b7-7afafad60bea', '559a0187-3031-4f61-a994-1562d2bd0d53', 'f2756a67-d913-49bc-a674-1dc6dc0d7864', '7aaf94c7-20fa-4468-8012-681f5448eb6b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:07:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:12 devstack sudo[85138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:07:12 devstack sudo[85138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:13 devstack sudo[85138]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.867s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:13 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:07:13 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Deleted volume successfully. Apr 15 10:07:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8a762fe1-c40e-44db-a4da-d42dd20112a3 tempest-VolumeRetypeWithoutMigrationTest-1682751690 None] Lock "cinder-8cefd90e-b58d-4f03-84c7-dfe2434dc0cc-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:15 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:07:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Flow 'volume_create_manager' (6d8e28b5-f018-4518-932c-8286586d37d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c556b37-4b6a-4dea-b307-4f957fc45e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c556b37-4b6a-4dea-b307-4f957fc45e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:15Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38c46e9-425c-494e-ba25-b38c25a98029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9383ac5299143f3ba6b1ea3bf3f7305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:15Z,use_quota=True,user_id='0fae784f5f394be4af3158d60b824fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0d023d-2641-4ca8-8237-4d45b7ce2769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0d023d-2641-4ca8-8237-4d45b7ce2769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e87f0c-5f7e-4238-84a7-28802f6c9a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:15 devstack cinder-volume[83167]: DEBUG cinder.image.glance [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Creating Keystone auth plugin from conf {{(pid=83167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 10:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e87f0c-5f7e-4238-84a7-28802f6c9a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b38c46e9-425c-494e-ba25-b38c25a98029', 'volume_name': 'volume-b38c46e9-425c-494e-ba25-b38c25a98029', 'volume_size': 1, 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3172424652674ff0ab6b0aa4f6bd806f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '634bcf17-826a-4375-a99f-9379442b55d9', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/634bcf17-826a-4375-a99f-9379442b55d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77baf232-064c-4a95-8d01-e1b422183c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77baf232-064c-4a95-8d01-e1b422183c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb213044-9518-48df-b2fd-d366b0d63dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:16 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Volume b38c46e9-425c-494e-ba25-b38c25a98029: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b38c46e9-425c-494e-ba25-b38c25a98029', 'volume_size': 1, 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3172424652674ff0ab6b0aa4f6bd806f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '634bcf17-826a-4375-a99f-9379442b55d9', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/634bcf17-826a-4375-a99f-9379442b55d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 10:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Trying to clone b38c46e9-425c-494e-ba25-b38c25a98029 from image 634bcf17-826a-4375-a99f-9379442b55d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]). {{(pid=83167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 10:07:16 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 10:07:16 devstack cinder-volume[83167]: INFO cinder.image.image_utils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Image download 20.69 MB at 20.69 MB/s Apr 15 10:07:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6aaa3d3-0468-4577-a6f4-39a7799a405c]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:16 devstack sudo[85192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD Apr 15 10:07:16 devstack sudo[85192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:17 devstack sudo[85192]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD" returned: 0 in 0.977s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:17 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Temporary image 634bcf17-826a-4375-a99f-9379442b55d9 is fetched for user 0fae784f5f394be4af3158d60b824fe7. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 10:07:17 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[51026b0c-2df5-4bb3-af83-424361e769eb]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:17 devstack sudo[85198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD Apr 15 10:07:17 devstack sudo[85198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:18 devstack sudo[85198]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD" returned: 0 in 0.638s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:15Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38c46e9-425c-494e-ba25-b38c25a98029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9383ac5299143f3ba6b1ea3bf3f7305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:15Z,use_quota=True,user_id='0fae784f5f394be4af3158d60b824fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:07:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Creating volume b38c46e9-425c-494e-ba25-b38c25a98029 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:07:18 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:18 devstack sudo[85220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 1073741824 Apr 15 10:07:18 devstack sudo[85220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:19 devstack sudo[85220]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 1073741824" returned: 0 in 0.916s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:19 devstack sudo[85225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 Apr 15 10:07:19 devstack sudo[85225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:19 devstack sudo[85225]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029" returned: 0 in 0.611s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:07:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:19 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Attempting download of 634bcf17-826a-4375-a99f-9379442b55d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}])) to volume b38c46e9-425c-494e-ba25-b38c25a98029. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 10:07:19 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed10cac-b7a9-43f9-ba2f-de98b987487a]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_tvcw1qdo {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:20 devstack sudo[85253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_tvcw1qdo Apr 15 10:07:20 devstack sudo[85253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:20 devstack sudo[85253]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_tvcw1qdo" returned: 0 in 1.106s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_tvcw1qdo {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:21 devstack sudo[85261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_tvcw1qdo Apr 15 10:07:21 devstack sudo[85261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:22 devstack sudo[85261]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_tvcw1qdo" returned: 1 in 1.320s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_tvcw1qdo' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:07:22 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[83287430-421d-47fa-96b2-c87d7c95c0ce]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:22 devstack sudo[85266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD Apr 15 10:07:22 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:23 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Flow 'volume_create_manager' (3bc8bdce-f5f9-4071-a019-49778ac5412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a477314f-8b69-41b4-b987-10afa56e4e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD" returned: 0 in 1.509s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] 634bcf17-826a-4375-a99f-9379442b55d9 was qcow2, converting to raw {{(pid=83167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a477314f-8b69-41b4-b987-10afa56e4e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-165949501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451dd70765de4c038626d3f699112da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:24Z,use_quota=True,user_id='e009a448405c4d1d876d77546f342a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:23 devstack sudo[85278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 Apr 15 10:07:23 devstack sudo[85278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b2e822-e79e-4fe3-95e2-65fcf360e5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b2e822-e79e-4fe3-95e2-65fcf360e5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cce8762-56ea-4530-b8cb-251113df7688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cce8762-56ea-4530-b8cb-251113df7688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94', 'volume_name': 'volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a8ac0e-5541-463d-9d21-4c52ff06ad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a8ac0e-5541-463d-9d21-4c52ff06ad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc8929b-441c-461c-8d85-7745108841cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:23 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Volume 22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94', 'volume_size': 1} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-165949501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451dd70765de4c038626d3f699112da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:24Z,use_quota=True,user_id='e009a448405c4d1d876d77546f342a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Creating volume 22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:07:23 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:23 devstack sudo[85280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94 1073741824 Apr 15 10:07:23 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:25 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94 1073741824" returned: 0 in 1.253s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:25 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94 Apr 15 10:07:25 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:25 devstack sudo[85278]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029" returned: 0 in 2.081s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:25 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_dc_3us7udevstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:07:25 devstack cinder-volume[83167]: INFO cinder.image.image_utils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Converted 112.00 MB image at 53.78 MB/s Apr 15 10:07:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:25 devstack sudo[85300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 1G Apr 15 10:07:25 devstack sudo[85300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:26 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94" returned: 0 in 0.902s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:07:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc8929b-441c-461c-8d85-7745108841cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57e7497-ebd3-4b52-9632-a8b40f2da27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:26 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Volume volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94 (22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94): created successfully Apr 15 10:07:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57e7497-ebd3-4b52-9632-a8b40f2da27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Flow 'volume_create_manager' (3bc8bdce-f5f9-4071-a019-49778ac5412b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-643a9835-9738-47bb-ae05-9c87cc520962 tempest-DeleteServersTestJSON-383082415 None] Created volume successfully. Apr 15 10:07:26 devstack sudo[85300]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 1G" returned: 0 in 0.953s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:26 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a26f20-21f1-4fe4-b986-9a30e8a144dc]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:27 devstack sudo[85307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 Apr 15 10:07:27 devstack sudo[85307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:28 devstack sudo[85307]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029" returned: 0 in 1.214s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:28 devstack sudo[85317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 Apr 15 10:07:28 devstack sudo[85317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:28 devstack sudo[85317]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029" returned: 1 in 0.554s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Downloaded image 634bcf17-826a-4375-a99f-9379442b55d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}])) to volume b38c46e9-425c-494e-ba25-b38c25a98029 successfully. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 10:07:28 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Temporary image 634bcf17-826a-4375-a99f-9379442b55d9 for user 0fae784f5f394be4af3158d60b824fe7 is deleted. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 10:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Marking volume b38c46e9-425c-494e-ba25-b38c25a98029 as bootable. {{(pid=83167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 10:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Copying metadata from image 634bcf17-826a-4375-a99f-9379442b55d9 to b38c46e9-425c-494e-ba25-b38c25a98029. {{(pid=83167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 10:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Creating volume glance metadata for volume b38c46e9-425c-494e-ba25-b38c25a98029 backed by image 634bcf17-826a-4375-a99f-9379442b55d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 10:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb213044-9518-48df-b2fd-d366b0d63dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b38c46e9-425c-494e-ba25-b38c25a98029', 'volume_size': 1, 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3172424652674ff0ab6b0aa4f6bd806f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '634bcf17-826a-4375-a99f-9379442b55d9', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/634bcf17-826a-4375-a99f-9379442b55d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302c6372-eb8d-4887-b9da-cf303f2df699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:28 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Volume volume-b38c46e9-425c-494e-ba25-b38c25a98029 (b38c46e9-425c-494e-ba25-b38c25a98029): created successfully Apr 15 10:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302c6372-eb8d-4887-b9da-cf303f2df699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Flow 'volume_create_manager' (6d8e28b5-f018-4518-932c-8286586d37d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:28 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-6bd02231-9578-4897-a8a3-614fd034c171 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Created volume successfully. Apr 15 10:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-ea2dae7a-8eff-43fc-8067-818de9de8a8b req-599bb244-702f-4ca7-9e24-439575686166 tempest-DeleteServersTestJSON-383082415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-ea2dae7a-8eff-43fc-8067-818de9de8a8b req-599bb244-702f-4ca7-9e24-439575686166 tempest-DeleteServersTestJSON-383082415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:30 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[935294f2-3e0d-475b-b69d-2d0f33a01313]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ea2dae7a-8eff-43fc-8067-818de9de8a8b req-599bb244-702f-4ca7-9e24-439575686166 tempest-DeleteServersTestJSON-383082415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:31 devstack sudo[85331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94 Apr 15 10:07:31 devstack sudo[85331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-badabdda-3b20-4114-8781-9cc796015652 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:31 devstack sudo[85331]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ea2dae7a-8eff-43fc-8067-818de9de8a8b req-599bb244-702f-4ca7-9e24-439575686166 tempest-DeleteServersTestJSON-383082415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94" returned: 0 in 0.868s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-ea2dae7a-8eff-43fc-8067-818de9de8a8b req-599bb244-702f-4ca7-9e24-439575686166 tempest-DeleteServersTestJSON-383082415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.926s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-badabdda-3b20-4114-8781-9cc796015652 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.614s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-ea2dae7a-8eff-43fc-8067-818de9de8a8b req-599bb244-702f-4ca7-9e24-439575686166 tempest-DeleteServersTestJSON-383082415 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b', 'name': 'volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2a84f79-1466-4122-919c-ef09649b5798', 'enforce_multipath': True} {{(pid=83167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 10:07:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[12442307-0b61-4953-8228-c1432bd16a1a]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-badabdda-3b20-4114-8781-9cc796015652 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-ea2dae7a-8eff-43fc-8067-818de9de8a8b req-599bb244-702f-4ca7-9e24-439575686166 tempest-DeleteServersTestJSON-383082415 None] attachment_update completed successfully. Apr 15 10:07:32 devstack sudo[85344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 Apr 15 10:07:32 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:33 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-badabdda-3b20-4114-8781-9cc796015652 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029" returned: 0 in 1.336s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-badabdda-3b20-4114-8781-9cc796015652 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:33 devstack sudo[85364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 Apr 15 10:07:33 devstack sudo[85364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:34 devstack sudo[85364]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-badabdda-3b20-4114-8781-9cc796015652 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029" returned: 1 in 0.911s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-badabdda-3b20-4114-8781-9cc796015652 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:07:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-badabdda-3b20-4114-8781-9cc796015652 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.328s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-badabdda-3b20-4114-8781-9cc796015652 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b', 'name': 'volume-b38c46e9-425c-494e-ba25-b38c25a98029', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d292b6f-2c9e-4c2e-912d-6d99762e5351', 'enforce_multipath': True} {{(pid=83167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 10:07:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-85e6748e-fba1-4a4b-90bc-af425cc8a69e req-badabdda-3b20-4114-8781-9cc796015652 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] attachment_update completed successfully. Apr 15 10:07:34 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:07:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Flow 'volume_create_manager' (4526550e-3ae3-41ee-a805-2d7a6ad6bd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ca4a9f-5a81-4119-8bcc-d838331870a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ca4a9f-5a81-4119-8bcc-d838331870a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1046981663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4428572-3f3a-47e3-b974-6cbc9d354277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe91f926b71f4ed88a1891ec4e6c5fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:35Z,use_quota=True,user_id='3a530f46224e4a95b1894ae9c3a99ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d0307f-9059-4fe9-acce-350f537551c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d0307f-9059-4fe9-acce-350f537551c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248a83d8-3f4c-4a6a-9892-67cdedfae30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:34 devstack cinder-volume[83167]: DEBUG cinder.image.glance [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Creating Keystone auth plugin from conf {{(pid=83167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 10:07:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248a83d8-3f4c-4a6a-9892-67cdedfae30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f4428572-3f3a-47e3-b974-6cbc9d354277', 'volume_name': 'volume-f4428572-3f3a-47e3-b974-6cbc9d354277', 'volume_size': 1, 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3172424652674ff0ab6b0aa4f6bd806f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '634bcf17-826a-4375-a99f-9379442b55d9', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/634bcf17-826a-4375-a99f-9379442b55d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80d9185-7d61-4b3f-92b7-64315b9043b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80d9185-7d61-4b3f-92b7-64315b9043b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8448a9e-440f-49c4-b5a6-d45c4788608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:35 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Volume f4428572-3f3a-47e3-b974-6cbc9d354277: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f4428572-3f3a-47e3-b974-6cbc9d354277', 'volume_size': 1, 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3172424652674ff0ab6b0aa4f6bd806f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '634bcf17-826a-4375-a99f-9379442b55d9', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/634bcf17-826a-4375-a99f-9379442b55d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 10:07:35 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Trying to clone f4428572-3f3a-47e3-b974-6cbc9d354277 from image 634bcf17-826a-4375-a99f-9379442b55d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]). {{(pid=83167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 10:07:35 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 10:07:35 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Image download 20.69 MB at 20.69 MB/s Apr 15 10:07:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[325cf684-4ade-48cd-b1b5-637e37efd7f4]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:35 devstack sudo[85392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD Apr 15 10:07:35 devstack sudo[85392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:36 devstack sudo[85392]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD" returned: 0 in 0.739s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:36 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Temporary image 634bcf17-826a-4375-a99f-9379442b55d9 is fetched for user 3a530f46224e4a95b1894ae9c3a99ec3. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 10:07:36 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[782fce3a-d0c4-42fb-9860-fab7ed6f1ace]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:36 devstack sudo[85397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD Apr 15 10:07:36 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:37 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD" returned: 0 in 0.679s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1046981663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4428572-3f3a-47e3-b974-6cbc9d354277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe91f926b71f4ed88a1891ec4e6c5fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:35Z,use_quota=True,user_id='3a530f46224e4a95b1894ae9c3a99ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Creating volume f4428572-3f3a-47e3-b974-6cbc9d354277 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:07:37 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:37 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 1073741824 Apr 15 10:07:37 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:37 devstack sudo[85412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:07:37 devstack sudo[85412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:37 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 1073741824" returned: 0 in 0.816s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:37 devstack sudo[85414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 Apr 15 10:07:37 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:38 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277" returned: 0 in 0.610s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:07:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:38 devstack sudo[85412]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.730s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:38 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:07:38 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Attempting download of 634bcf17-826a-4375-a99f-9379442b55d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}])) to volume f4428572-3f3a-47e3-b974-6cbc9d354277. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 10:07:38 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c15352f-de26-49a3-977b-01f54bd0e634]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vhko_zxi {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:38 devstack sudo[85450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vhko_zxi Apr 15 10:07:38 devstack sudo[85450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:39 devstack sudo[85450]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vhko_zxi" returned: 0 in 0.675s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vhko_zxi {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:39 devstack sudo[85479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vhko_zxi Apr 15 10:07:39 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:39 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vhko_zxi" returned: 1 in 0.632s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vhko_zxi' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:07:39 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ae3605-5739-44f7-8a85-dbb17055b16f]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:40 devstack sudo[85487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD Apr 15 10:07:40 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:40 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD" returned: 0 in 0.764s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:40 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] 634bcf17-826a-4375-a99f-9379442b55d9 was qcow2, converting to raw {{(pid=83167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 10:07:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:40 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 Apr 15 10:07:40 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:41 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-0d25ae84-dd08-4b36-bfd5-074a284fa783 req-e6cf884c-e4e8-43ff-b505-825e1ad02c8d tempest-DeleteServersTestJSON-383082415 None] Terminate volume connection completed successfully. Apr 15 10:07:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-0d25ae84-dd08-4b36-bfd5-074a284fa783 req-e6cf884c-e4e8-43ff-b505-825e1ad02c8d tempest-DeleteServersTestJSON-383082415 None] Deleting attachment f2a84f79-1466-4122-919c-ef09649b5798. {{(pid=83167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 10:07:42 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277" returned: 0 in 1.592s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:42 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_h2hgnod1devstack@QuobyteHD, size 112.00 MB, duration 1.59 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:07:42 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Converted 112.00 MB image at 70.30 MB/s Apr 15 10:07:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:42 devstack sudo[85503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 1G Apr 15 10:07:42 devstack sudo[85503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:43 devstack sudo[85503]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 1G" returned: 0 in 0.947s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:43 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a224385-cf8f-4772-ac6f-e5e8c444251e]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:43 devstack sudo[85508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 Apr 15 10:07:43 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:44 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277" returned: 0 in 0.762s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:44 devstack sudo[85513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 Apr 15 10:07:44 devstack sudo[85513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:44 devstack sudo[85513]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277" returned: 1 in 0.783s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Downloaded image 634bcf17-826a-4375-a99f-9379442b55d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}])) to volume f4428572-3f3a-47e3-b974-6cbc9d354277 successfully. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 10:07:44 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Temporary image 634bcf17-826a-4375-a99f-9379442b55d9 for user 3a530f46224e4a95b1894ae9c3a99ec3 is deleted. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 10:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Marking volume f4428572-3f3a-47e3-b974-6cbc9d354277 as bootable. {{(pid=83167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 10:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Copying metadata from image 634bcf17-826a-4375-a99f-9379442b55d9 to f4428572-3f3a-47e3-b974-6cbc9d354277. {{(pid=83167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 10:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Creating volume glance metadata for volume f4428572-3f3a-47e3-b974-6cbc9d354277 backed by image 634bcf17-826a-4375-a99f-9379442b55d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 10:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8448a9e-440f-49c4-b5a6-d45c4788608a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4428572-3f3a-47e3-b974-6cbc9d354277', 'volume_size': 1, 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3172424652674ff0ab6b0aa4f6bd806f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '634bcf17-826a-4375-a99f-9379442b55d9', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/634bcf17-826a-4375-a99f-9379442b55d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a17ae0-1ff5-4fa7-8c4e-9e23efaf931e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:44 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Volume volume-f4428572-3f3a-47e3-b974-6cbc9d354277 (f4428572-3f3a-47e3-b974-6cbc9d354277): created successfully Apr 15 10:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a17ae0-1ff5-4fa7-8c4e-9e23efaf931e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Flow 'volume_create_manager' (4526550e-3ae3-41ee-a805-2d7a6ad6bd58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:45 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-128f3bf3-5d57-4c4c-9a7e-2f51c84bd696 tempest-VolumesImageMetadata-519189937 None] Created volume successfully. Apr 15 10:07:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Acquiring lock "cinder-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Lock "cinder-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Acquiring lock "cinder-quobyte-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Lock "cinder-quobyte-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94" acquired by "delete_volume" :: waited 0.043s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:45 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b39c20-80ae-4927-8105-82f12000d5c3]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:46 devstack sudo[85520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94 Apr 15 10:07:46 devstack sudo[85520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Acquiring lock "cinder-f4428572-3f3a-47e3-b974-6cbc9d354277-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Lock "cinder-f4428572-3f3a-47e3-b974-6cbc9d354277-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Acquiring lock "cinder-quobyte-f4428572-3f3a-47e3-b974-6cbc9d354277" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Lock "cinder-quobyte-f4428572-3f3a-47e3-b974-6cbc9d354277" acquired by "delete_volume" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:46 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda02d84-f478-424b-947d-449b6835192f]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:46 devstack sudo[85523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 Apr 15 10:07:46 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:47 devstack sudo[85520]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94" returned: 0 in 1.169s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:47 devstack sudo[85528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94 Apr 15 10:07:47 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:47 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277" returned: 0 in 1.287s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:47 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94" returned: 0 in 0.771s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Lock "cinder-quobyte-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94" released by "delete_volume" :: held 2.039s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:47 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Created reservations ['66f1b95d-039a-4ed3-87b1-73af321fb2d0', 'c7db1dfd-5534-4b84-b060-aca8e2084661', 'f4510bb2-c160-4cfc-aba3-6d55d89c11dd', '90bb27d1-413e-4c59-8453-52caec8245c4'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:07:48 devstack sudo[85539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 Apr 15 10:07:48 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:48 devstack sudo[85555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:07:48 devstack sudo[85555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:48 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277" returned: 1 in 0.843s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:07:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:48 devstack sudo[85555]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.611s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:48 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:07:48 devstack sudo[85566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277 Apr 15 10:07:48 devstack sudo[85566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Deleted volume successfully. Apr 15 10:07:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-09467301-b71e-47a9-9d2c-8fd92542953c tempest-DeleteServersTestJSON-383082415 None] Lock "cinder-22f5bfb4-3a60-4b1a-a09b-1abb8db6fa94-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:49 devstack sudo[85566]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f4428572-3f3a-47e3-b974-6cbc9d354277" returned: 0 in 0.581s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Lock "cinder-quobyte-f4428572-3f3a-47e3-b974-6cbc9d354277" released by "delete_volume" :: held 2.803s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:49 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Created reservations ['a990938e-f61c-454a-9345-de4c195049aa', 'c58a74a4-4186-43d5-8da5-175b6d80f80e', 'd8eb52bc-971e-450a-982f-0f737c2560bc', '0a8b50f2-e1d0-4bf1-a11b-284176bdf743'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:07:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:49 devstack sudo[85574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:07:49 devstack sudo[85574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:50 devstack sudo[85574]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.680s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:50 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:07:50 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Deleted volume successfully. Apr 15 10:07:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-670018cc-1849-431b-8f9b-957d44a4f1cb tempest-VolumesImageMetadata-519189937 None] Lock "cinder-f4428572-3f3a-47e3-b974-6cbc9d354277-delete_volume" released by "delete_volume" :: held 3.726s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Flow 'volume_create_manager' (52964969-a39a-493e-9ffc-4c7c3c1cc0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef487a53-5ce4-496b-b53a-22a65343f6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef487a53-5ce4-496b-b53a-22a65343f6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-718202664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8344c6de-39de-447b-b130-411369182cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4a754a686e455c898a611b59f54a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:52Z,use_quota=True,user_id='b177ce70983c42a5a8061a924cf5c1a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947e1442-6b34-47dd-86ca-d8fede5dc8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947e1442-6b34-47dd-86ca-d8fede5dc8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e745bf-e323-4ab0-9cb6-f8696722bd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.image.glance [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Creating Keystone auth plugin from conf {{(pid=83167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e745bf-e323-4ab0-9cb6-f8696722bd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8344c6de-39de-447b-b130-411369182cc3', 'volume_name': 'volume-8344c6de-39de-447b-b130-411369182cc3', 'volume_size': 1, 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3172424652674ff0ab6b0aa4f6bd806f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '634bcf17-826a-4375-a99f-9379442b55d9', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/634bcf17-826a-4375-a99f-9379442b55d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c403e961-d432-491c-82b6-04eabf9b2e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c403e961-d432-491c-82b6-04eabf9b2e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82abc346-f48e-40f9-b664-2d034afa962f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:52 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Volume 8344c6de-39de-447b-b130-411369182cc3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8344c6de-39de-447b-b130-411369182cc3', 'volume_size': 1, 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3172424652674ff0ab6b0aa4f6bd806f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '634bcf17-826a-4375-a99f-9379442b55d9', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/634bcf17-826a-4375-a99f-9379442b55d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Trying to clone 8344c6de-39de-447b-b130-411369182cc3 from image 634bcf17-826a-4375-a99f-9379442b55d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]). {{(pid=83167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 10:07:52 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Image download 20.69 MB at 20.69 MB/s Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7975f9f-9905-4b62-9a2d-bd9fcc7d7c19]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:52 devstack sudo[85599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD Apr 15 10:07:52 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:53 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD" returned: 0 in 0.578s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Temporary image 634bcf17-826a-4375-a99f-9379442b55d9 is fetched for user b177ce70983c42a5a8061a924cf5c1a8. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4464d71-04b5-46e0-8c4b-5b641e1a56cf]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:53 devstack sudo[85607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD Apr 15 10:07:53 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:53 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD" returned: 0 in 0.548s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-718202664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8344c6de-39de-447b-b130-411369182cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4a754a686e455c898a611b59f54a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:52Z,use_quota=True,user_id='b177ce70983c42a5a8061a924cf5c1a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Creating volume 8344c6de-39de-447b-b130-411369182cc3 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:07:53 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:53 devstack sudo[85613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 1073741824 Apr 15 10:07:53 devstack sudo[85613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:54 devstack sudo[85613]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 1073741824" returned: 0 in 0.887s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:54 devstack sudo[85644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 Apr 15 10:07:54 devstack sudo[85644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:55 devstack sudo[85644]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3" returned: 0 in 0.979s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:07:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:55 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Attempting download of 634bcf17-826a-4375-a99f-9379442b55d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}])) to volume 8344c6de-39de-447b-b130-411369182cc3. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 10:07:55 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c95db01-91e7-4f03-9012-1ee08736cbc4]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vyvf71pv {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:55 devstack sudo[85664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vyvf71pv Apr 15 10:07:55 devstack sudo[85664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:56 devstack sudo[85664]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vyvf71pv" returned: 0 in 0.767s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vyvf71pv {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:56 devstack sudo[85670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vyvf71pv Apr 15 10:07:56 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:57 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vyvf71pv" returned: 1 in 0.586s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_vyvf71pv' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:07:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[863ac44a-11b4-4efb-a4f9-4c2f988ad74a]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:57 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD Apr 15 10:07:57 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:57 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:57 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] 634bcf17-826a-4375-a99f-9379442b55d9 was qcow2, converting to raw {{(pid=83167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 10:07:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:57 devstack sudo[85682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 Apr 15 10:07:57 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:58 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3" returned: 0 in 1.387s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:58 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_81osqswzdevstack@QuobyteHD, size 112.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:07:58 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Converted 112.00 MB image at 80.59 MB/s Apr 15 10:07:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:59 devstack sudo[85689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 1G Apr 15 10:07:59 devstack sudo[85689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:59 devstack sudo[85689]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 1G" returned: 0 in 0.709s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:59 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a8d17d-dd42-446f-8494-747e9ae1caf2]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:59 devstack sudo[85700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 Apr 15 10:07:59 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:00 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3" returned: 0 in 0.711s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:00 devstack sudo[85735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 Apr 15 10:08:00 devstack sudo[85735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:01 devstack sudo[85735]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3" returned: 1 in 1.089s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:08:01 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Downloaded image 634bcf17-826a-4375-a99f-9379442b55d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}])) to volume 8344c6de-39de-447b-b130-411369182cc3 successfully. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 10:08:01 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Temporary image 634bcf17-826a-4375-a99f-9379442b55d9 for user b177ce70983c42a5a8061a924cf5c1a8 is deleted. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 10:08:01 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Marking volume 8344c6de-39de-447b-b130-411369182cc3 as bootable. {{(pid=83167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 10:08:01 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=58,cinder:SELECT=65,cinder:DELETE=4,cinder:INSERT=11 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:08:01 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Copying metadata from image 634bcf17-826a-4375-a99f-9379442b55d9 to 8344c6de-39de-447b-b130-411369182cc3. {{(pid=83167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 10:08:01 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Creating volume glance metadata for volume 8344c6de-39de-447b-b130-411369182cc3 backed by image 634bcf17-826a-4375-a99f-9379442b55d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 10:08:01 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=76,cinder:INSERT=38,cinder:UPDATE=64,cinder:DELETE=4 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:08:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82abc346-f48e-40f9-b664-2d034afa962f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8344c6de-39de-447b-b130-411369182cc3', 'volume_size': 1, 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3172424652674ff0ab6b0aa4f6bd806f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '634bcf17-826a-4375-a99f-9379442b55d9', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/634bcf17-826a-4375-a99f-9379442b55d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f904331d-b89d-4dbb-93cd-f9d9d2578def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:01 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Volume volume-8344c6de-39de-447b-b130-411369182cc3 (8344c6de-39de-447b-b130-411369182cc3): created successfully Apr 15 10:08:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f904331d-b89d-4dbb-93cd-f9d9d2578def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Flow 'volume_create_manager' (52964969-a39a-493e-9ffc-4c7c3c1cc0ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c984f43e-837a-4a10-a358-43678027159c tempest-VolumesExtendTest-1200592952 None] Created volume successfully. Apr 15 10:08:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9d016b50-ee55-47d6-8183-cbaf826eacb5 tempest-VolumesExtendTest-1200592952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9d016b50-ee55-47d6-8183-cbaf826eacb5 tempest-VolumesExtendTest-1200592952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:03 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb8a0f4-4d6a-4622-bf54-be85c217c8cb]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9d016b50-ee55-47d6-8183-cbaf826eacb5 tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:03 devstack sudo[85795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 Apr 15 10:08:03 devstack sudo[85795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:04 devstack sudo[85795]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9d016b50-ee55-47d6-8183-cbaf826eacb5 tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3" returned: 0 in 0.904s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9d016b50-ee55-47d6-8183-cbaf826eacb5 tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:04 devstack sudo[85805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 Apr 15 10:08:04 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:04 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9d016b50-ee55-47d6-8183-cbaf826eacb5 tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3" returned: 1 in 0.741s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9d016b50-ee55-47d6-8183-cbaf826eacb5 tempest-VolumesExtendTest-1200592952 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9d016b50-ee55-47d6-8183-cbaf826eacb5 tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 2G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9d016b50-ee55-47d6-8183-cbaf826eacb5 tempest-VolumesExtendTest-1200592952 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 2G" returned: 0 in 0.084s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9d016b50-ee55-47d6-8183-cbaf826eacb5 tempest-VolumesExtendTest-1200592952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.814s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:05 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9d016b50-ee55-47d6-8183-cbaf826eacb5 tempest-VolumesExtendTest-1200592952 None] Extend volume completed successfully. Apr 15 10:08:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Acquiring lock "cinder-8344c6de-39de-447b-b130-411369182cc3-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Lock "cinder-8344c6de-39de-447b-b130-411369182cc3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Acquiring lock "cinder-quobyte-8344c6de-39de-447b-b130-411369182cc3" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Lock "cinder-quobyte-8344c6de-39de-447b-b130-411369182cc3" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:05 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3931288-1793-4f9f-9707-2b9b39b10d6d]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:05 devstack sudo[85831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 Apr 15 10:08:05 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:06 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3" returned: 0 in 1.152s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:06 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 Apr 15 10:08:06 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-c1ffc084-5788-4372-ae1b-7f927e420eb7 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Terminate volume connection completed successfully. Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-c1ffc084-5788-4372-ae1b-7f927e420eb7 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Deleting attachment 0d292b6f-2c9e-4c2e-912d-6d99762e5351. {{(pid=83167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Flow 'volume_create_manager' (406a476d-8927-43cd-a775-b06299bdd099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6546ee13-2c08-4286-bceb-1ed09775eb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6546ee13-2c08-4286-bceb-1ed09775eb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1829204426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86927de8-993d-4328-bad5-c854c9d2f36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0789a1eaa84f308f033b54eddab77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:07Z,use_quota=True,user_id='425355c09c9a4fe7b6669eb29c3cde07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6723ff9-ee75-4b55-aed9-6ea11a0f66cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6723ff9-ee75-4b55-aed9-6ea11a0f66cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5afa05-ed8c-4078-8f09-c2cd821dd686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5afa05-ed8c-4078-8f09-c2cd821dd686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86927de8-993d-4328-bad5-c854c9d2f36c', 'volume_name': 'volume-86927de8-993d-4328-bad5-c854c9d2f36c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6147e492-c645-414a-9f44-c702aafe44b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6147e492-c645-414a-9f44-c702aafe44b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f0efe5-b5e6-44e5-ab49-c9a71db81485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Volume 86927de8-993d-4328-bad5-c854c9d2f36c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86927de8-993d-4328-bad5-c854c9d2f36c', 'volume_size': 1} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1829204426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86927de8-993d-4328-bad5-c854c9d2f36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0789a1eaa84f308f033b54eddab77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:07Z,use_quota=True,user_id='425355c09c9a4fe7b6669eb29c3cde07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Creating volume 86927de8-993d-4328-bad5-c854c9d2f36c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:07 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-86927de8-993d-4328-bad5-c854c9d2f36c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:07 devstack sudo[85845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-86927de8-993d-4328-bad5-c854c9d2f36c 1073741824 Apr 15 10:08:07 devstack sudo[85845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:07 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3" returned: 1 in 1.042s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:07 devstack sudo[85850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3 Apr 15 10:08:07 devstack sudo[85850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Acquiring lock "cinder-b38c46e9-425c-494e-ba25-b38c25a98029-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "cinder-b38c46e9-425c-494e-ba25-b38c25a98029-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Acquiring lock "cinder-quobyte-b38c46e9-425c-494e-ba25-b38c25a98029" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "cinder-quobyte-b38c46e9-425c-494e-ba25-b38c25a98029" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00ff774-5df0-4671-ae80-ad8af9ca17bf]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:08 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 Apr 15 10:08:08 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:08 devstack sudo[85845]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-86927de8-993d-4328-bad5-c854c9d2f36c 1073741824" returned: 0 in 0.657s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-86927de8-993d-4328-bad5-c854c9d2f36c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:08 devstack sudo[85859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-86927de8-993d-4328-bad5-c854c9d2f36c Apr 15 10:08:08 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:08 devstack sudo[85850]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8344c6de-39de-447b-b130-411369182cc3" returned: 0 in 0.557s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Lock "cinder-quobyte-8344c6de-39de-447b-b130-411369182cc3" released by "delete_volume" :: held 2.838s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Created reservations ['0dec3874-adbd-4f1a-aa79-75819ff9ac81', '08de4a85-69c8-4a13-bba5-3d06331a2c3d', '7c679948-98ae-4df3-a262-c06e6f68e87c', 'eb846124-c4bf-4c21-849a-929dc4b371a8'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:08 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029" returned: 0 in 0.752s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:08 devstack sudo[85864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:08:08 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:09 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 Apr 15 10:08:09 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:09 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-86927de8-993d-4328-bad5-c854c9d2f36c" returned: 0 in 0.790s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f0efe5-b5e6-44e5-ab49-c9a71db81485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86927de8-993d-4328-bad5-c854c9d2f36c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d562beb7-3061-416b-a51b-8bd57f4a8f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:09 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Volume volume-86927de8-993d-4328-bad5-c854c9d2f36c (86927de8-993d-4328-bad5-c854c9d2f36c): created successfully Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d562beb7-3061-416b-a51b-8bd57f4a8f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Flow 'volume_create_manager' (406a476d-8927-43cd-a775-b06299bdd099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-957a2d1c-f3f0-430f-b36f-807ab4c29736 tempest-VolumesActionsTest-712634776 None] Created volume successfully. Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Flow 'volume_create_manager' (e331086f-cc59-44d9-877d-719a8981fff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1462b10-6929-411e-9517-ad4c5e6d3e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1462b10-6929-411e-9517-ad4c5e6d3e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1521145730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19536a2-0fe6-4667-84b8-47662eb72b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4a754a686e455c898a611b59f54a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:09Z,use_quota=True,user_id='b177ce70983c42a5a8061a924cf5c1a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a986ea77-5e68-4166-8b07-f783123e7d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a986ea77-5e68-4166-8b07-f783123e7d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c56fa03c-e788-4479-bbb3-f91a966c8aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c56fa03c-e788-4479-bbb3-f91a966c8aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b19536a2-0fe6-4667-84b8-47662eb72b20', 'volume_name': 'volume-b19536a2-0fe6-4667-84b8-47662eb72b20', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d5ad70-f38b-4b19-bafe-47c4473497dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d5ad70-f38b-4b19-bafe-47c4473497dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50984c0b-c9ae-4041-ba24-e4ac3a18e9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:09 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Volume b19536a2-0fe6-4667-84b8-47662eb72b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b19536a2-0fe6-4667-84b8-47662eb72b20', 'volume_size': 1} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1521145730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19536a2-0fe6-4667-84b8-47662eb72b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4a754a686e455c898a611b59f54a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:09Z,use_quota=True,user_id='b177ce70983c42a5a8061a924cf5c1a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Creating volume b19536a2-0fe6-4667-84b8-47662eb72b20 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:09 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:09 devstack sudo[85869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 1073741824 Apr 15 10:08:09 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:09 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.578s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Deleted volume successfully. Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b815268-40fb-4155-8d46-d8027dea3b01 tempest-VolumesExtendTest-1200592952 None] Lock "cinder-8344c6de-39de-447b-b130-411369182cc3-delete_volume" released by "delete_volume" :: held 3.901s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3f6bf21d-a14f-493a-b2b3-a69f3dcb5d25 tempest-VolumesActionsTest-712634776 None] Acquiring lock "cinder-86927de8-993d-4328-bad5-c854c9d2f36c" by "attach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3f6bf21d-a14f-493a-b2b3-a69f3dcb5d25 tempest-VolumesActionsTest-712634776 None] Lock "cinder-86927de8-993d-4328-bad5-c854c9d2f36c" acquired by "attach_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3f6bf21d-a14f-493a-b2b3-a69f3dcb5d25 tempest-VolumesActionsTest-712634776 None] Attaching volume 86927de8-993d-4328-bad5-c854c9d2f36c to instance ffdf9ffc-ba94-43b7-8fb6-9aca2fc75690 at mountpoint /dev/vdb on host None. Apr 15 10:08:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3f6bf21d-a14f-493a-b2b3-a69f3dcb5d25 tempest-VolumesActionsTest-712634776 None] Attach volume completed successfully. Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3f6bf21d-a14f-493a-b2b3-a69f3dcb5d25 tempest-VolumesActionsTest-712634776 None] Lock "cinder-86927de8-993d-4328-bad5-c854c9d2f36c" released by "attach_volume" :: held 0.075s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:09 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029" returned: 1 in 0.805s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:09 devstack sudo[85875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029 Apr 15 10:08:09 devstack sudo[85875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:09 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 1073741824" returned: 0 in 0.634s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:10 devstack sudo[85880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 Apr 15 10:08:10 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:10 devstack sudo[85875]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b38c46e9-425c-494e-ba25-b38c25a98029" returned: 0 in 0.450s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "cinder-quobyte-b38c46e9-425c-494e-ba25-b38c25a98029" released by "delete_volume" :: held 2.062s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG cinder.quota [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Created reservations ['490f041f-6e8c-4b64-aec9-05a89a783f67', '5d555280-6ea2-4a2a-b93b-20c6711c2d72', '16c442c6-20ad-4b21-a63b-34c7c6201b07', 'ba6cd073-b874-493d-8ddd-5f2b7ee8c46f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:10 devstack sudo[85883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:08:10 devstack sudo[85883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:10 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20" returned: 0 in 0.494s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50984c0b-c9ae-4041-ba24-e4ac3a18e9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19536a2-0fe6-4667-84b8-47662eb72b20', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4102781c-5e0f-4ba8-b8e3-2f614b2c8ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:10 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Volume volume-b19536a2-0fe6-4667-84b8-47662eb72b20 (b19536a2-0fe6-4667-84b8-47662eb72b20): created successfully Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4102781c-5e0f-4ba8-b8e3-2f614b2c8ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Flow 'volume_create_manager' (e331086f-cc59-44d9-877d-719a8981fff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:10 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-293b52d9-c7dd-49ff-abe8-70c0c86484c8 tempest-VolumesExtendTest-1200592952 None] Created volume successfully. Apr 15 10:08:10 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8bed3c8b-d10a-424a-b272-2be21ef8cd1b tempest-VolumesActionsTest-286693660 None] Terminate volume connection completed successfully. Apr 15 10:08:10 devstack sudo[85883]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG cinder.manager [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:10 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Deleted volume successfully. Apr 15 10:08:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-de9011d1-dc93-4122-ad47-3f2684ea1e13 req-38806d81-338b-4ad5-b9ca-465ceabbe437 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "cinder-b38c46e9-425c-494e-ba25-b38c25a98029-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8bed3c8b-d10a-424a-b272-2be21ef8cd1b tempest-VolumesActionsTest-286693660 None] Acquiring lock "cinder-86927de8-993d-4328-bad5-c854c9d2f36c-detach_volume" by "detach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8bed3c8b-d10a-424a-b272-2be21ef8cd1b tempest-VolumesActionsTest-286693660 None] Lock "cinder-86927de8-993d-4328-bad5-c854c9d2f36c-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:11 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8bed3c8b-d10a-424a-b272-2be21ef8cd1b tempest-VolumesActionsTest-286693660 None] Detaching volume 86927de8-993d-4328-bad5-c854c9d2f36c from instance ffdf9ffc-ba94-43b7-8fb6-9aca2fc75690. Apr 15 10:08:11 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8bed3c8b-d10a-424a-b272-2be21ef8cd1b tempest-VolumesActionsTest-286693660 None] Detach volume completed successfully. Apr 15 10:08:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8bed3c8b-d10a-424a-b272-2be21ef8cd1b tempest-VolumesActionsTest-286693660 None] Lock "cinder-86927de8-993d-4328-bad5-c854c9d2f36c-detach_volume" released by "detach_volume" :: held 0.052s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] Creating offline snapshot a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a of volume b19536a2-0fe6-4667-84b8-47662eb72b20 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:08:11 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[291657c2-467e-4452-9f31-06bfe4fda8ed]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:11 devstack sudo[85888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 Apr 15 10:08:11 devstack sudo[85888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3576d88-5db7-4b57-a001-b3c0af9079a9 tempest-VolumesActionsTest-712634776 None] Acquiring lock "cinder-86927de8-993d-4328-bad5-c854c9d2f36c-detach_volume" by "detach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3576d88-5db7-4b57-a001-b3c0af9079a9 tempest-VolumesActionsTest-712634776 None] Lock "cinder-86927de8-993d-4328-bad5-c854c9d2f36c-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:11 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c3576d88-5db7-4b57-a001-b3c0af9079a9 tempest-VolumesActionsTest-712634776 None] Volume detach called, but volume not attached. Apr 15 10:08:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3576d88-5db7-4b57-a001-b3c0af9079a9 tempest-VolumesActionsTest-712634776 None] Lock "cinder-86927de8-993d-4328-bad5-c854c9d2f36c-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:12 devstack sudo[85888]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20" returned: 0 in 0.650s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:12 devstack sudo[85893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a 1G Apr 15 10:08:12 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Acquiring lock "cinder-86927de8-993d-4328-bad5-c854c9d2f36c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Lock "cinder-86927de8-993d-4328-bad5-c854c9d2f36c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Acquiring lock "cinder-quobyte-86927de8-993d-4328-bad5-c854c9d2f36c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Lock "cinder-quobyte-86927de8-993d-4328-bad5-c854c9d2f36c" acquired by "delete_volume" :: waited 0.006s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e1fb09-fc6a-49c8-8c60-58f67a412f4e]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-86927de8-993d-4328-bad5-c854c9d2f36c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:12 devstack sudo[85895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-86927de8-993d-4328-bad5-c854c9d2f36c Apr 15 10:08:12 devstack sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:13 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a 1G" returned: 0 in 0.864s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19536a2-0fe6-4667-84b8-47662eb72b20 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:13 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19536a2-0fe6-4667-84b8-47662eb72b20 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a Apr 15 10:08:13 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:13 devstack sudo[85895]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-86927de8-993d-4328-bad5-c854c9d2f36c" returned: 0 in 1.025s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-86927de8-993d-4328-bad5-c854c9d2f36c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:13 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-86927de8-993d-4328-bad5-c854c9d2f36c Apr 15 10:08:13 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:14 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19536a2-0fe6-4667-84b8-47662eb72b20 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a" returned: 0 in 1.035s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:14 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a is being set with open permissions: ugo+rw Apr 15 10:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:14 devstack sudo[85944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a Apr 15 10:08:14 devstack sudo[85944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:14 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-86927de8-993d-4328-bad5-c854c9d2f36c" returned: 0 in 0.866s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Lock "cinder-quobyte-86927de8-993d-4328-bad5-c854c9d2f36c" released by "delete_volume" :: held 1.912s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:14 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Created reservations ['0cf7c462-774e-472d-8070-e0f440e35fd8', 'be343044-2f2d-441f-a1c3-b959a2d017aa', '835343ac-327b-41ed-b3cd-68544a599e2f', '2dc7022f-b72e-469b-939d-a12aeac7a02b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:14 devstack sudo[85953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:08:14 devstack sudo[85953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:15 devstack sudo[85944]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a" returned: 0 in 0.998s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:15 devstack sudo[85967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.info Apr 15 10:08:15 devstack sudo[85967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:15 devstack sudo[85953]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.855s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:15 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Deleted volume successfully. Apr 15 10:08:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-122b0acc-9180-40db-89e2-56a591832593 tempest-VolumesActionsTest-712634776 None] Lock "cinder-86927de8-993d-4328-bad5-c854c9d2f36c-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:15 devstack sudo[85967]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.info" returned: 0 in 0.540s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:15 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.info is being set with open permissions: ugo+rw Apr 15 10:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:15 devstack sudo[85972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.info Apr 15 10:08:15 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:16 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.info" returned: 0 in 0.518s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.703s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-df77f7bf-ce94-4a79-8e40-76852791bf7d tempest-VolumesExtendTest-1200592952 None] Create snapshot completed successfully Apr 15 10:08:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-25a470df-5078-4359-a000-f074d851f10b tempest-VolumesExtendTest-1200592952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-25a470df-5078-4359-a000-f074d851f10b tempest-VolumesExtendTest-1200592952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ac7763-6c15-43b5-b2aa-a4ee05869e31]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-25a470df-5078-4359-a000-f074d851f10b tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:16 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 Apr 15 10:08:16 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:17 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-25a470df-5078-4359-a000-f074d851f10b tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20" returned: 0 in 0.582s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-25a470df-5078-4359-a000-f074d851f10b tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a 2G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-25a470df-5078-4359-a000-f074d851f10b tempest-VolumesExtendTest-1200592952 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a 2G" returned: 0 in 0.099s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-25a470df-5078-4359-a000-f074d851f10b tempest-VolumesExtendTest-1200592952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.700s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-25a470df-5078-4359-a000-f074d851f10b tempest-VolumesExtendTest-1200592952 None] Extend volume completed successfully. Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Acquiring lock "cinder-a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Lock "cinder-a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Acquiring lock "cinder-quobyte-b19536a2-0fe6-4667-84b8-47662eb72b20" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Lock "cinder-quobyte-b19536a2-0fe6-4667-84b8-47662eb72b20" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Acquiring lock "cinder-quobyte-a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Lock "cinder-quobyte-a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Deleting offline snapshot a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a of volume b19536a2-0fe6-4667-84b8-47662eb72b20 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] snapshot_file for this snap is: volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f626d-88ca-4557-ab34-a897b6a5831b]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:18 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a Apr 15 10:08:18 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:18 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a" returned: 0 in 0.649s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b19536a2-0fe6-4667-84b8-47662eb72b20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1641691-969a-4f15-832a-1d958c520ab1]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:18 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 Apr 15 10:08:18 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:19 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20" returned: 0 in 0.520s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:19 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a Apr 15 10:08:19 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:20 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a" returned: 0 in 0.810s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:20 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a Apr 15 10:08:20 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:20 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20.a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a" returned: 0 in 0.673s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Lock "cinder-quobyte-a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a" released by "_delete_snapshot" :: held 2.739s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Lock "cinder-quobyte-b19536a2-0fe6-4667-84b8-47662eb72b20" released by "delete_snapshot" :: held 2.756s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:20 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Created reservations ['e625a069-0ae7-4a19-9771-879ffac84e7d', '7d27990b-8bc3-4639-a783-3014c7f970f8', '98b8d56f-2008-4ec4-9a6d-630efe3cb000', '2493537d-7c45-4e58-839e-ab47cf1e1117'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Delete snapshot completed successfully. Apr 15 10:08:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b3f93e95-31ca-418f-a1f8-5e37aa6a246a tempest-VolumesExtendTest-1200592952 None] Lock "cinder-a6ae95a0-2f7c-421a-9ee3-d1e2af1eff7a-delete_snapshot" released by "delete_snapshot" :: held 2.863s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Acquiring lock "cinder-b19536a2-0fe6-4667-84b8-47662eb72b20-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Lock "cinder-b19536a2-0fe6-4667-84b8-47662eb72b20-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Acquiring lock "cinder-quobyte-b19536a2-0fe6-4667-84b8-47662eb72b20" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Lock "cinder-quobyte-b19536a2-0fe6-4667-84b8-47662eb72b20" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:21 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eda6ed-5793-478c-b653-0fe40625135d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:21 devstack sudo[86108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 Apr 15 10:08:21 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:21 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-0a5a0404-d059-4dd9-b2bc-367a750afe68 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Terminate volume connection completed successfully. Apr 15 10:08:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-0a5a0404-d059-4dd9-b2bc-367a750afe68 tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Deleting attachment 098e1148-fd83-46a0-a0f7-25017e95cf46. {{(pid=83167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 10:08:21 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20" returned: 0 in 0.566s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:21 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20 Apr 15 10:08:21 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:22 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b19536a2-0fe6-4667-84b8-47662eb72b20" returned: 0 in 0.408s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Lock "cinder-quobyte-b19536a2-0fe6-4667-84b8-47662eb72b20" released by "delete_volume" :: held 1.048s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Created reservations ['11dc418d-fdba-4db7-b8eb-552a7918ab6e', 'a1e98085-bdee-47d6-8977-c30b222eedec', 'f43b2de0-c51b-48c2-b25c-431e58b13397', '2ea3432e-2bdd-4682-b74b-210b98ed02aa'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:22 devstack sudo[86117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:08:22 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Acquiring lock "cinder-910a0e13-5678-4cee-929a-7511ebe1d147-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "cinder-910a0e13-5678-4cee-929a-7511ebe1d147-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Acquiring lock "cinder-quobyte-910a0e13-5678-4cee-929a-7511ebe1d147" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "cinder-quobyte-910a0e13-5678-4cee-929a-7511ebe1d147" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ff7a5a-eb30-403f-b961-b734c8a9535e]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:22 devstack sudo[86119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147 Apr 15 10:08:22 devstack sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:23 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.698s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Deleted volume successfully. Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7e9e37fd-00df-4126-aed7-e78938b6ff53 tempest-VolumesExtendTest-1200592952 None] Lock "cinder-b19536a2-0fe6-4667-84b8-47662eb72b20-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Flow 'volume_create_manager' (125e95df-5bf3-47e4-b204-67fcde7351ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fa261b-d98a-4afb-bf14-015b5172da77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fa261b-d98a-4afb-bf14-015b5172da77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1614176665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7996dce-b78f-484e-a97f-1a122ee2b957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0789a1eaa84f308f033b54eddab77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:23Z,use_quota=True,user_id='425355c09c9a4fe7b6669eb29c3cde07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56f31c9-7494-465e-85d0-1c8bac39d2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56f31c9-7494-465e-85d0-1c8bac39d2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca60d4e0-2dcf-4cdf-a945-8a7a0cb7354c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca60d4e0-2dcf-4cdf-a945-8a7a0cb7354c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7996dce-b78f-484e-a97f-1a122ee2b957', 'volume_name': 'volume-e7996dce-b78f-484e-a97f-1a122ee2b957', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d18d82-db26-4395-a3be-ba31f3f37822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d18d82-db26-4395-a3be-ba31f3f37822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b25308-dff0-448c-8660-b50a97cebc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:23 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Volume e7996dce-b78f-484e-a97f-1a122ee2b957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7996dce-b78f-484e-a97f-1a122ee2b957', 'volume_size': 1} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1614176665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7996dce-b78f-484e-a97f-1a122ee2b957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0789a1eaa84f308f033b54eddab77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:23Z,use_quota=True,user_id='425355c09c9a4fe7b6669eb29c3cde07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Creating volume e7996dce-b78f-484e-a97f-1a122ee2b957 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:23 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e7996dce-b78f-484e-a97f-1a122ee2b957 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:23 devstack sudo[86119]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147" returned: 0 in 0.679s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:23 devstack sudo[86126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e7996dce-b78f-484e-a97f-1a122ee2b957 1073741824 Apr 15 10:08:23 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:23 devstack sudo[86127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147 Apr 15 10:08:23 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:24 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-910a0e13-5678-4cee-929a-7511ebe1d147" returned: 0 in 0.650s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "cinder-quobyte-910a0e13-5678-4cee-929a-7511ebe1d147" released by "delete_volume" :: held 1.406s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG cinder.quota [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Created reservations ['0373da63-7d02-422a-a1ff-50559704c288', '69bfa1b5-bcb1-4d46-847f-e1813d270ca7', 'ce759173-6a10-4bf7-b6ff-25cc01ecc871', 'c6fb8b47-ecf9-4098-8ee6-bcac2c1e0326'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:24 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:08:24 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:24 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e7996dce-b78f-484e-a97f-1a122ee2b957 1073741824" returned: 0 in 0.973s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e7996dce-b78f-484e-a97f-1a122ee2b957 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:24 devstack sudo[86146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e7996dce-b78f-484e-a97f-1a122ee2b957 Apr 15 10:08:24 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:24 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.479s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG cinder.manager [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Deleted volume successfully. Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-7574fcec-5106-4afd-98e8-d8a8f8e38322 req-45eb23b1-0f4c-450c-b420-6cfaeb1a1eaf tempest-ServerBootFromVolumeStableRescueTest-1494667472 None] Lock "cinder-910a0e13-5678-4cee-929a-7511ebe1d147-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:24 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e7996dce-b78f-484e-a97f-1a122ee2b957" returned: 0 in 0.610s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b25308-dff0-448c-8660-b50a97cebc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7996dce-b78f-484e-a97f-1a122ee2b957', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186794b1-b0b4-45d1-a6e2-5329fa03b979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:25 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Volume volume-e7996dce-b78f-484e-a97f-1a122ee2b957 (e7996dce-b78f-484e-a97f-1a122ee2b957): created successfully Apr 15 10:08:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186794b1-b0b4-45d1-a6e2-5329fa03b979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Flow 'volume_create_manager' (125e95df-5bf3-47e4-b204-67fcde7351ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-459c25c3-20b4-4a32-a623-02b3581d8767 tempest-VolumesActionsTest-712634776 None] Created volume successfully. Apr 15 10:08:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Acquiring lock "cinder-e7996dce-b78f-484e-a97f-1a122ee2b957-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Lock "cinder-e7996dce-b78f-484e-a97f-1a122ee2b957-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Acquiring lock "cinder-quobyte-e7996dce-b78f-484e-a97f-1a122ee2b957" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Lock "cinder-quobyte-e7996dce-b78f-484e-a97f-1a122ee2b957" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:25 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2118dfd9-b441-43bc-9ec5-2d62df9fe010]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e7996dce-b78f-484e-a97f-1a122ee2b957 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:26 devstack sudo[86152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e7996dce-b78f-484e-a97f-1a122ee2b957 Apr 15 10:08:26 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (fa2ca805-83c7-4bf6-919d-a1933e73eee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1568f0a5-f0ed-4f8a-b5c1-05c3db0be33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1568f0a5-f0ed-4f8a-b5c1-05c3db0be33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1078689164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eac8aa7-2c5f-4a31-bd1b-03253456ca15,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88c69b291132490889e6d33fbe6ce17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:26Z,use_quota=True,user_id='0d3df5897f2548629dd2cf795ec91b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3466a6-b6df-4930-9f63-7387057a72d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3466a6-b6df-4930-9f63-7387057a72d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd76d95-a5ea-424b-9f09-3421addb9846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd76d95-a5ea-424b-9f09-3421addb9846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eac8aa7-2c5f-4a31-bd1b-03253456ca15', 'volume_name': 'volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1446d079-12b2-49dc-a40a-01982355af9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1446d079-12b2-49dc-a40a-01982355af9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a01894-ad7b-48b7-8236-31785e809a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:26 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Volume 7eac8aa7-2c5f-4a31-bd1b-03253456ca15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15', 'volume_size': 1} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1078689164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eac8aa7-2c5f-4a31-bd1b-03253456ca15,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88c69b291132490889e6d33fbe6ce17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:26Z,use_quota=True,user_id='0d3df5897f2548629dd2cf795ec91b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Creating volume 7eac8aa7-2c5f-4a31-bd1b-03253456ca15 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:26 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:26 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15 1073741824 Apr 15 10:08:26 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:26 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e7996dce-b78f-484e-a97f-1a122ee2b957" returned: 0 in 0.732s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e7996dce-b78f-484e-a97f-1a122ee2b957 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:26 devstack sudo[86167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e7996dce-b78f-484e-a97f-1a122ee2b957 Apr 15 10:08:26 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:27 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e7996dce-b78f-484e-a97f-1a122ee2b957" returned: 0 in 0.749s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Lock "cinder-quobyte-e7996dce-b78f-484e-a97f-1a122ee2b957" released by "delete_volume" :: held 1.517s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Created reservations ['b3e1591d-0515-4f73-91ea-f45711ff6dd5', '8d5a5a00-c514-4add-9cd7-7d33c956b754', 'e30be096-d5e7-4255-ad8e-02051192e778', '919a0892-9dd9-4ca4-9e4d-a36c704a0369'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:27 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15 1073741824" returned: 0 in 0.956s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:27 devstack sudo[86196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:08:27 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:27 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15 Apr 15 10:08:27 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:27 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15" returned: 0 in 0.467s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a01894-ad7b-48b7-8236-31785e809a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674ec772-53f4-4021-90de-914340729f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:28 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.543s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:28 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Deleted volume successfully. Apr 15 10:08:28 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Volume volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15 (7eac8aa7-2c5f-4a31-bd1b-03253456ca15): created successfully Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674ec772-53f4-4021-90de-914340729f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (fa2ca805-83c7-4bf6-919d-a1933e73eee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:28 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-149a5ac3-38af-484f-ad39-2cb47449b282 tempest-VolumesGetTest-1525924872 None] Created volume successfully. Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-711a9c8c-04e6-4337-a1c7-d61d401047ec tempest-VolumesActionsTest-286693660 None] Lock "cinder-e7996dce-b78f-484e-a97f-1a122ee2b957-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Flow 'volume_create_manager' (3d9599d6-1621-4105-bf14-7e3c47c97ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1617498e-3ff4-41cb-9b85-72bbcc569f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1617498e-3ff4-41cb-9b85-72bbcc569f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-618058582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56b3e41-4e40-410f-80c8-b441c7f8a949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0789a1eaa84f308f033b54eddab77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:28Z,use_quota=True,user_id='425355c09c9a4fe7b6669eb29c3cde07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a176392c-d252-4ce9-92c5-ed288badea80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a176392c-d252-4ce9-92c5-ed288badea80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0390a6b-85af-4520-88ff-a7f68502def3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0390a6b-85af-4520-88ff-a7f68502def3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a56b3e41-4e40-410f-80c8-b441c7f8a949', 'volume_name': 'volume-a56b3e41-4e40-410f-80c8-b441c7f8a949', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba33fc14-7bc3-4507-a5b9-b8cb91a6a12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba33fc14-7bc3-4507-a5b9-b8cb91a6a12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18aa5ab4-dd6c-4606-89c3-11af987e8e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:28 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Volume a56b3e41-4e40-410f-80c8-b441c7f8a949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a56b3e41-4e40-410f-80c8-b441c7f8a949', 'volume_size': 1} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-618058582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56b3e41-4e40-410f-80c8-b441c7f8a949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0789a1eaa84f308f033b54eddab77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:28Z,use_quota=True,user_id='425355c09c9a4fe7b6669eb29c3cde07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Creating volume a56b3e41-4e40-410f-80c8-b441c7f8a949 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:28 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a56b3e41-4e40-410f-80c8-b441c7f8a949 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:28 devstack sudo[86204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a56b3e41-4e40-410f-80c8-b441c7f8a949 1073741824 Apr 15 10:08:28 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (af28efa4-056f-4489-addf-a45e9f78d525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65405c6d-2726-4dd0-a7fc-8dac3562b285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65405c6d-2726-4dd0-a7fc-8dac3562b285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1259504765',display_name='tempest-VolumesGetTest-Volume-1480693682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a722f91-9d95-4905-9b3e-7a23efa7c434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c69b291132490889e6d33fbe6ce17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:29Z,use_quota=True,user_id='0d3df5897f2548629dd2cf795ec91b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a0d8be-7012-4c11-a0ce-52ed95402fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a0d8be-7012-4c11-a0ce-52ed95402fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e128436d-340d-46c5-8b4b-9d271cbcfa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e128436d-340d-46c5-8b4b-9d271cbcfa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a722f91-9d95-4905-9b3e-7a23efa7c434', 'volume_name': 'volume-8a722f91-9d95-4905-9b3e-7a23efa7c434', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ef845d-cd9a-4283-9e13-cd6728ddaf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ef845d-cd9a-4283-9e13-cd6728ddaf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87019b0b-d7ca-474f-941c-f0a8d797a951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:29 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Volume 8a722f91-9d95-4905-9b3e-7a23efa7c434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a722f91-9d95-4905-9b3e-7a23efa7c434', 'volume_size': 1} Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:29 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a56b3e41-4e40-410f-80c8-b441c7f8a949 1073741824" returned: 0 in 0.903s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a56b3e41-4e40-410f-80c8-b441c7f8a949 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:29 devstack sudo[86210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a56b3e41-4e40-410f-80c8-b441c7f8a949 Apr 15 10:08:29 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:30 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a56b3e41-4e40-410f-80c8-b441c7f8a949" returned: 0 in 0.692s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1259504765',display_name='tempest-VolumesGetTest-Volume-1480693682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a722f91-9d95-4905-9b3e-7a23efa7c434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c69b291132490889e6d33fbe6ce17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:29Z,use_quota=True,user_id='0d3df5897f2548629dd2cf795ec91b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Creating volume 8a722f91-9d95-4905-9b3e-7a23efa7c434 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:30 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8a722f91-9d95-4905-9b3e-7a23efa7c434 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18aa5ab4-dd6c-4606-89c3-11af987e8e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a56b3e41-4e40-410f-80c8-b441c7f8a949', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0738dbdf-c547-44c7-96eb-075c79306407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:30 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Volume volume-a56b3e41-4e40-410f-80c8-b441c7f8a949 (a56b3e41-4e40-410f-80c8-b441c7f8a949): created successfully Apr 15 10:08:30 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8a722f91-9d95-4905-9b3e-7a23efa7c434 1073741824 Apr 15 10:08:30 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0738dbdf-c547-44c7-96eb-075c79306407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Flow 'volume_create_manager' (3d9599d6-1621-4105-bf14-7e3c47c97ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-92abc247-8236-4ff5-a4d2-e286a56efdcb tempest-VolumesActionsTest-712634776 None] Created volume successfully. Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Acquiring lock "cinder-a56b3e41-4e40-410f-80c8-b441c7f8a949-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Lock "cinder-a56b3e41-4e40-410f-80c8-b441c7f8a949-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Acquiring lock "cinder-quobyte-a56b3e41-4e40-410f-80c8-b441c7f8a949" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Lock "cinder-quobyte-a56b3e41-4e40-410f-80c8-b441c7f8a949" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec219f8-1d8d-4738-b92d-ddf3e9201f0e]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a56b3e41-4e40-410f-80c8-b441c7f8a949 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:31 devstack sudo[86235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a56b3e41-4e40-410f-80c8-b441c7f8a949 Apr 15 10:08:31 devstack sudo[86235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:31 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8a722f91-9d95-4905-9b3e-7a23efa7c434 1073741824" returned: 0 in 0.936s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8a722f91-9d95-4905-9b3e-7a23efa7c434 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:31 devstack sudo[86237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8a722f91-9d95-4905-9b3e-7a23efa7c434 Apr 15 10:08:31 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:31 devstack sudo[86235]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a56b3e41-4e40-410f-80c8-b441c7f8a949" returned: 0 in 0.543s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a56b3e41-4e40-410f-80c8-b441c7f8a949 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:31 devstack sudo[86242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a56b3e41-4e40-410f-80c8-b441c7f8a949 Apr 15 10:08:31 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:31 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8a722f91-9d95-4905-9b3e-7a23efa7c434" returned: 0 in 0.464s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87019b0b-d7ca-474f-941c-f0a8d797a951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a722f91-9d95-4905-9b3e-7a23efa7c434', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc880cce-98f0-4c48-aece-94212f7435a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:31 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Volume volume-8a722f91-9d95-4905-9b3e-7a23efa7c434 (8a722f91-9d95-4905-9b3e-7a23efa7c434): created successfully Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc880cce-98f0-4c48-aece-94212f7435a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (af28efa4-056f-4489-addf-a45e9f78d525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ec1ff707-d4ed-42aa-81a1-75fad1263fe4 tempest-VolumesGetTest-1525924872 None] Created volume successfully. Apr 15 10:08:32 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a56b3e41-4e40-410f-80c8-b441c7f8a949" returned: 0 in 0.429s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Lock "cinder-quobyte-a56b3e41-4e40-410f-80c8-b441c7f8a949" released by "delete_volume" :: held 1.010s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Created reservations ['2e1c1cff-46a3-49d9-af42-b98aa7b2628e', 'd3055130-8820-40fe-b688-5bf7b6c48cfb', '838402f0-43d1-4bb6-9fd6-76109c3fcca9', 'a4d3c7ac-f11f-4357-b904-0d49a0b046ab'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:32 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:08:32 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-8a722f91-9d95-4905-9b3e-7a23efa7c434-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Lock "cinder-8a722f91-9d95-4905-9b3e-7a23efa7c434-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-quobyte-8a722f91-9d95-4905-9b3e-7a23efa7c434" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-8a722f91-9d95-4905-9b3e-7a23efa7c434" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cf6d45-e6ee-4f2c-aed8-00accf824c34]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8a722f91-9d95-4905-9b3e-7a23efa7c434 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:32 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Deleted volume successfully. Apr 15 10:08:32 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8a722f91-9d95-4905-9b3e-7a23efa7c434 Apr 15 10:08:32 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-196bdffd-9e75-454f-9bb4-40a5d0a085e5 tempest-VolumesActionsTest-286693660 None] Lock "cinder-a56b3e41-4e40-410f-80c8-b441c7f8a949-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:33 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8a722f91-9d95-4905-9b3e-7a23efa7c434" returned: 0 in 0.600s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8a722f91-9d95-4905-9b3e-7a23efa7c434 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:33 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8a722f91-9d95-4905-9b3e-7a23efa7c434 Apr 15 10:08:33 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Flow 'volume_create_manager' (b32003d0-2b70-4f93-98a3-3f682e1ea8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d3ab7f-e8f1-43c6-9fed-23e7fb9587f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d3ab7f-e8f1-43c6-9fed-23e7fb9587f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1402219383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0000ad9-acd5-4d65-9d18-38e1d6c6c749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0789a1eaa84f308f033b54eddab77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:33Z,use_quota=True,user_id='425355c09c9a4fe7b6669eb29c3cde07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6787084-1630-42aa-9f8d-803af1f4c6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6787084-1630-42aa-9f8d-803af1f4c6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5bffa9-8792-49cd-bba9-3d0514e5c91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5bffa9-8792-49cd-bba9-3d0514e5c91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0000ad9-acd5-4d65-9d18-38e1d6c6c749', 'volume_name': 'volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caee6706-8e22-402c-88a4-a4116665e3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caee6706-8e22-402c-88a4-a4116665e3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbf8b44-0a6d-4da5-8296-fe722153d453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:33 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Volume e0000ad9-acd5-4d65-9d18-38e1d6c6c749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749', 'volume_size': 1} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1402219383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0000ad9-acd5-4d65-9d18-38e1d6c6c749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0789a1eaa84f308f033b54eddab77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:33Z,use_quota=True,user_id='425355c09c9a4fe7b6669eb29c3cde07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Creating volume e0000ad9-acd5-4d65-9d18-38e1d6c6c749 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:33 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:08:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:33 devstack sudo[86256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749 1073741824 Apr 15 10:08:33 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:34 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8a722f91-9d95-4905-9b3e-7a23efa7c434" returned: 0 in 0.893s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-8a722f91-9d95-4905-9b3e-7a23efa7c434" released by "delete_volume" :: held 1.538s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Created reservations ['3053501a-f5cc-47fe-827c-b6c5e2ac20d6', 'e0d4747c-01c1-4661-a72f-0c26f659f072', '90655061-02b8-403f-94c8-446ba184a6de', '4d9562d3-ecee-4eb1-8922-d91d249c8643'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:34 devstack sudo[86297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:08:34 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:34 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749 1073741824" returned: 0 in 0.942s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:34 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749 Apr 15 10:08:34 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:34 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.621s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Deleted volume successfully. Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-795264dc-6870-4776-b153-0deba1809bc9 tempest-VolumesGetTest-1525924872 None] Lock "cinder-8a722f91-9d95-4905-9b3e-7a23efa7c434-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-7eac8aa7-2c5f-4a31-bd1b-03253456ca15-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Lock "cinder-7eac8aa7-2c5f-4a31-bd1b-03253456ca15-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-quobyte-7eac8aa7-2c5f-4a31-bd1b-03253456ca15" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-7eac8aa7-2c5f-4a31-bd1b-03253456ca15" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1372fef-ed41-45cb-8e14-195bb1e9fd8c]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:35 devstack sudo[86305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15 Apr 15 10:08:35 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:35 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749" returned: 0 in 0.749s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbf8b44-0a6d-4da5-8296-fe722153d453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f78ade0-a265-4197-ace9-ac95fe2c2b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:35 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Volume volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749 (e0000ad9-acd5-4d65-9d18-38e1d6c6c749): created successfully Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f78ade0-a265-4197-ace9-ac95fe2c2b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Flow 'volume_create_manager' (b32003d0-2b70-4f93-98a3-3f682e1ea8b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:35 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-24d26a53-d89c-4a96-a1e8-f9d6589b268b tempest-VolumesActionsTest-712634776 None] Created volume successfully. Apr 15 10:08:35 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15" returned: 0 in 0.759s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:35 devstack sudo[86338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15 Apr 15 10:08:35 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Acquiring lock "cinder-e0000ad9-acd5-4d65-9d18-38e1d6c6c749-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Lock "cinder-e0000ad9-acd5-4d65-9d18-38e1d6c6c749-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Acquiring lock "cinder-quobyte-e0000ad9-acd5-4d65-9d18-38e1d6c6c749" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Lock "cinder-quobyte-e0000ad9-acd5-4d65-9d18-38e1d6c6c749" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:36 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3438fb92-ebe2-4c84-87da-ab5d2319e59d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:36 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749 Apr 15 10:08:36 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:37 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7eac8aa7-2c5f-4a31-bd1b-03253456ca15" returned: 0 in 1.480s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-7eac8aa7-2c5f-4a31-bd1b-03253456ca15" released by "delete_volume" :: held 2.281s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Created reservations ['6efb17c5-c740-4e9e-9ae2-c37f46ebcfbf', 'a56c22c1-616d-46aa-8ee0-3e4bd83a55be', '2c87563d-1344-4515-ac89-daf0dc7e20fa', '95320e2a-5e50-4d68-86b4-2e6b1960e534'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:37 devstack sudo[86353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:08:37 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:37 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749" returned: 0 in 1.461s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:37 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749 Apr 15 10:08:37 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:37 devstack sudo[86357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:08:37 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:38 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.090s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:38 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:38 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Deleted volume successfully. Apr 15 10:08:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-158b9a5c-2142-4284-b7de-49fd54c2898f tempest-VolumesGetTest-1525924872 None] Lock "cinder-7eac8aa7-2c5f-4a31-bd1b-03253456ca15-delete_volume" released by "delete_volume" :: held 3.716s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:38 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0000ad9-acd5-4d65-9d18-38e1d6c6c749" returned: 0 in 1.093s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Lock "cinder-quobyte-e0000ad9-acd5-4d65-9d18-38e1d6c6c749" released by "delete_volume" :: held 2.659s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:38 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Created reservations ['8e5432e2-a798-46d0-bc48-82d7a568e385', '1d7f2fd4-88ee-4229-925d-d5522dc59ff6', 'b54a3c70-f761-423a-bd17-9dfddeaaeb01', '4c6f9f4f-8c6e-4f91-b338-ce0b843bdf98'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:39 devstack sudo[86364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:08:39 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (b1cd3939-604f-4cb4-b2c1-ad9fdcfb62f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122a98a8-2023-46ad-b35f-d50ac49cdced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122a98a8-2023-46ad-b35f-d50ac49cdced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-97513512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5877d08d-a0bd-4a7f-9578-d525a5547255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c69b291132490889e6d33fbe6ce17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:39Z,use_quota=True,user_id='0d3df5897f2548629dd2cf795ec91b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d62b73-cd47-4e86-837f-529c298e9ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d62b73-cd47-4e86-837f-529c298e9ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b38c46-de91-4286-95f8-0502a7a9e8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b38c46-de91-4286-95f8-0502a7a9e8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5877d08d-a0bd-4a7f-9578-d525a5547255', 'volume_name': 'volume-5877d08d-a0bd-4a7f-9578-d525a5547255', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9258cf8-4a50-482b-a7a0-af92b30e8a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9258cf8-4a50-482b-a7a0-af92b30e8a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf4e177-eb45-4913-ba87-23d4676f9be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:39 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Volume 5877d08d-a0bd-4a7f-9578-d525a5547255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5877d08d-a0bd-4a7f-9578-d525a5547255', 'volume_size': 1} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-97513512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5877d08d-a0bd-4a7f-9578-d525a5547255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c69b291132490889e6d33fbe6ce17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:39Z,use_quota=True,user_id='0d3df5897f2548629dd2cf795ec91b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Creating volume 5877d08d-a0bd-4a7f-9578-d525a5547255 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:39 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:39 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 1073741824 Apr 15 10:08:39 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:39 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.651s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Flow 'volume_create_manager' (f7b90bb7-25d7-4d0c-aad8-59af31ec4f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501e5878-a8cc-406a-934c-d3fea80cce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501e5878-a8cc-406a-934c-d3fea80cce10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1394865281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67c770b-c1f7-4b63-92cc-6363c7c1b9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0789a1eaa84f308f033b54eddab77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:40Z,use_quota=True,user_id='425355c09c9a4fe7b6669eb29c3cde07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa63472f-7200-4b4b-a597-5a01c37f04a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa63472f-7200-4b4b-a597-5a01c37f04a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66dd65d8-059c-4151-98d1-6ff493c8cbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66dd65d8-059c-4151-98d1-6ff493c8cbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd67c770b-c1f7-4b63-92cc-6363c7c1b9f1', 'volume_name': 'volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341a1023-9af1-45f5-acf0-11c6b2d5b95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341a1023-9af1-45f5-acf0-11c6b2d5b95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae9b881-64b5-4bb1-b186-d6d6506ae502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:40 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Volume d67c770b-c1f7-4b63-92cc-6363c7c1b9f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1', 'volume_size': 1} Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:40 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.280s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:40 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Deleted volume successfully. Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8a51112d-4533-416f-8d44-3d1ce49886e4 tempest-VolumesActionsTest-286693660 None] Lock "cinder-e0000ad9-acd5-4d65-9d18-38e1d6c6c749-delete_volume" released by "delete_volume" :: held 4.280s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:40 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 1073741824" returned: 0 in 1.076s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:40 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 Apr 15 10:08:40 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:41 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255" returned: 0 in 0.618s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.984s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1394865281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67c770b-c1f7-4b63-92cc-6363c7c1b9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0789a1eaa84f308f033b54eddab77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:40Z,use_quota=True,user_id='425355c09c9a4fe7b6669eb29c3cde07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Creating volume d67c770b-c1f7-4b63-92cc-6363c7c1b9f1 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:41 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf4e177-eb45-4913-ba87-23d4676f9be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5877d08d-a0bd-4a7f-9578-d525a5547255', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3a62f3-0ed3-4db5-86d6-d47672e93af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:41 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1 1073741824 Apr 15 10:08:41 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:41 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Volume volume-5877d08d-a0bd-4a7f-9578-d525a5547255 (5877d08d-a0bd-4a7f-9578-d525a5547255): created successfully Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3a62f3-0ed3-4db5-86d6-d47672e93af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (b1cd3939-604f-4cb4-b2c1-ad9fdcfb62f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:41 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-afabc9fb-ad68-4727-865d-5be246cd114a tempest-VolumesGetTest-1525924872 None] Created volume successfully. Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (6d5de177-6685-48e3-9400-ce9e2c946cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438b76c2-928d-4ea2-8475-83c5b1784fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438b76c2-928d-4ea2-8475-83c5b1784fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-109610388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ce57bb-7310-4deb-a224-a8e9e8cb94db,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88c69b291132490889e6d33fbe6ce17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5877d08d-a0bd-4a7f-9578-d525a5547255,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:42Z,use_quota=True,user_id='0d3df5897f2548629dd2cf795ec91b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7858d7c8-1051-4fcb-9f49-ced25035d928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7858d7c8-1051-4fcb-9f49-ced25035d928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c14892-8ea4-415f-a73d-7d1dc009d216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c14892-8ea4-415f-a73d-7d1dc009d216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '17ce57bb-7310-4deb-a224-a8e9e8cb94db', 'volume_name': 'volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db', 'volume_size': 1, 'source_volid': '5877d08d-a0bd-4a7f-9578-d525a5547255', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae287994-76c2-43e0-a4ea-bfb73b11439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae287994-76c2-43e0-a4ea-bfb73b11439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7aa84c-eeb1-4939-8967-2fc11997cd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:41 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Volume 17ce57bb-7310-4deb-a224-a8e9e8cb94db: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db', 'volume_size': 1, 'source_volid': '5877d08d-a0bd-4a7f-9578-d525a5547255', 'source_volstatus': 'available'} Apr 15 10:08:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:42 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1 1073741824" returned: 0 in 1.244s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:42 devstack sudo[86415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1 Apr 15 10:08:42 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:42 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1" returned: 0 in 0.516s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.979s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:42 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Cloning volume 5877d08d-a0bd-4a7f-9578-d525a5547255 to volume 17ce57bb-7310-4deb-a224-a8e9e8cb94db Apr 15 10:08:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Creating offline snapshot 768e2c1c-c807-4f0a-9aab-6d345eb232a4 of volume 5877d08d-a0bd-4a7f-9578-d525a5547255 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:08:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae9b881-64b5-4bb1-b186-d6d6506ae502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcf7955-6bd2-476a-ab46-a13909be1d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:42 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Volume volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1 (d67c770b-c1f7-4b63-92cc-6363c7c1b9f1): created successfully Apr 15 10:08:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcf7955-6bd2-476a-ab46-a13909be1d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Flow 'volume_create_manager' (f7b90bb7-25d7-4d0c-aad8-59af31ec4f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:42 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e11fe2-d890-4efc-8531-f1fc98b297d0]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:42 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e6b00215-b5d9-4407-9801-b28c566e279a tempest-VolumesActionsTest-712634776 None] Created volume successfully. Apr 15 10:08:42 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 Apr 15 10:08:42 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Acquiring lock "cinder-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Lock "cinder-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Acquiring lock "cinder-quobyte-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Lock "cinder-quobyte-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:43 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[855d25f1-da2b-4dcb-b920-f37e62ffd473]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:43 devstack sudo[86425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1 Apr 15 10:08:43 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:43 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255" returned: 0 in 0.621s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:43 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 1G Apr 15 10:08:43 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:44 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1" returned: 0 in 0.665s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:44 devstack sudo[86437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1 Apr 15 10:08:44 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:44 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 1G" returned: 0 in 0.654s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5877d08d-a0bd-4a7f-9578-d525a5547255 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:44 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5877d08d-a0bd-4a7f-9578-d525a5547255 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 Apr 15 10:08:44 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:44 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1" returned: 0 in 0.543s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Lock "cinder-quobyte-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1" released by "delete_volume" :: held 1.239s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Created reservations ['ac58e2a2-bb0a-4de0-868f-f78c24c02424', 'eec91837-4a6f-4f3f-9e8f-7063a9c48b9e', 'b9e59a19-cf7f-4bf4-b60f-7fbfcf7de757', '99005713-7d2c-4b07-b28a-07fb632848b5'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:44 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:08:44 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:44 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5877d08d-a0bd-4a7f-9578-d525a5547255 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4" returned: 0 in 0.632s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:44 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 is being set with open permissions: ugo+rw Apr 15 10:08:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:44 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 Apr 15 10:08:44 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:45 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4" returned: 0 in 0.593s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:45 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.info Apr 15 10:08:45 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:45 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.892s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:45 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:45 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Deleted volume successfully. Apr 15 10:08:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-23e48622-e3aa-4fb7-9ede-69532ed29320 tempest-VolumesActionsTest-286693660 None] Lock "cinder-d67c770b-c1f7-4b63-92cc-6363c7c1b9f1-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Flow 'volume_create_manager' (450e5233-fb7e-4354-b268-2917bd06398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9695ddc0-f168-468e-a942-ce1cb32aee2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9695ddc0-f168-468e-a942-ce1cb32aee2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-4960669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519967b8-b8f8-4d50-8d43-4bac8e5d86db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0789a1eaa84f308f033b54eddab77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:46Z,use_quota=True,user_id='425355c09c9a4fe7b6669eb29c3cde07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1037b1-4747-4cb7-b613-e7c34e5687aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1037b1-4747-4cb7-b613-e7c34e5687aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594b0370-a1c6-487e-8675-c3527b84394f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594b0370-a1c6-487e-8675-c3527b84394f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '519967b8-b8f8-4d50-8d43-4bac8e5d86db', 'volume_name': 'volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8710fb-8626-4524-a269-52a4d81564be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8710fb-8626-4524-a269-52a4d81564be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40040dcd-1ee8-44d1-a777-16449243a80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:46 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Volume 519967b8-b8f8-4d50-8d43-4bac8e5d86db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db', 'volume_size': 1} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:46 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.info" returned: 0 in 0.878s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:46 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.info is being set with open permissions: ugo+rw Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:46 devstack sudo[86459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.info Apr 15 10:08:46 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Flow 'volume_create_manager' (9c053197-013b-478a-8ba0-1a6a987adf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12f8957-7f88-47f6-87e5-e61e413d3dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12f8957-7f88-47f6-87e5-e61e413d3dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-81614848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1eeb65bddc7464d8f2717e74816a569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:47Z,use_quota=True,user_id='1eac5e41e7cc41e0aeaae42807b1b6e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec7a19f-c58d-4bb4-9980-544d8f9f8760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec7a19f-c58d-4bb4-9980-544d8f9f8760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02911452-1910-473b-be55-3869e3dc3f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02911452-1910-473b-be55-3869e3dc3f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb', 'volume_name': 'volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bd0089-437d-4e00-a17a-11198c33bbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bd0089-437d-4e00-a17a-11198c33bbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0119bb-e6ed-4fbc-a179-52326ddd863a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:46 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Volume 1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb', 'volume_size': 1} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:46 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.info" returned: 0 in 0.645s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-quobyte-17ce57bb-7310-4deb-a224-a8e9e8cb94db" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-17ce57bb-7310-4deb-a224-a8e9e8cb94db" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] snapshot: 768e2c1c-c807-4f0a-9aab-6d345eb232a4, volume: 17ce57bb-7310-4deb-a224-a8e9e8cb94db, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f7510e-75fa-4313-ad89-e28ffe6779bb]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:47 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 Apr 15 10:08:47 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:47 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4" returned: 0 in 0.593s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5877d08d-a0bd-4a7f-9578-d525a5547255(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] will copy from snapshot at /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd0aeb9-6319-4312-8960-f3754b01a445]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:47 devstack sudo[86468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 Apr 15 10:08:47 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:48 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255" returned: 0 in 0.642s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:48 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Path /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:08:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:48 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db Apr 15 10:08:48 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:51 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db" returned: 0 in 3.069s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:51 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[886763b9-309f-48d7-ab7e-76dcec5a0086]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:51 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 Apr 15 10:08:51 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:52 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255" returned: 0 in 0.951s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:52 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255, size 1024.00 MB, duration 3.07 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:08:52 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Converted 1024.00 MB image at 333.38 MB/s Apr 15 10:08:52 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db is being set with open permissions: ugo+rw Apr 15 10:08:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:52 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db Apr 15 10:08:52 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:52 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db" returned: 0 in 0.522s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-17ce57bb-7310-4deb-a224-a8e9e8cb94db" released by "_copy_volume_from_snapshot" :: held 5.866s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-quobyte-768e2c1c-c807-4f0a-9aab-6d345eb232a4" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-768e2c1c-c807-4f0a-9aab-6d345eb232a4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Deleting offline snapshot 768e2c1c-c807-4f0a-9aab-6d345eb232a4 of volume 5877d08d-a0bd-4a7f-9578-d525a5547255 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:08:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] snapshot_file for this snap is: volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:08:52 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[635e14f7-594f-443e-983d-6251cd99b487]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:52 devstack sudo[86493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 Apr 15 10:08:52 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:53 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4" returned: 0 in 0.583s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5877d08d-a0bd-4a7f-9578-d525a5547255(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:08:53 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f844b4d9-8697-455c-9897-2ab795f343ce]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:53 devstack sudo[86502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 Apr 15 10:08:53 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:54 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255" returned: 0 in 0.727s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:54 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 Apr 15 10:08:54 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:54 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4" returned: 0 in 0.527s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:54 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4 Apr 15 10:08:54 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:55 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255.768e2c1c-c807-4f0a-9aab-6d345eb232a4" returned: 0 in 0.429s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-768e2c1c-c807-4f0a-9aab-6d345eb232a4" released by "_delete_snapshot" :: held 2.355s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.472s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.107s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-4960669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519967b8-b8f8-4d50-8d43-4bac8e5d86db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0789a1eaa84f308f033b54eddab77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:46Z,use_quota=True,user_id='425355c09c9a4fe7b6669eb29c3cde07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Creating volume 519967b8-b8f8-4d50-8d43-4bac8e5d86db {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:55 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7aa84c-eeb1-4939-8967-2fc11997cd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db', 'volume_size': 1, 'source_volid': '5877d08d-a0bd-4a7f-9578-d525a5547255', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa37fc2a-f661-4115-a729-96cb8b87a574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:55 devstack sudo[86520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db 1073741824 Apr 15 10:08:55 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:55 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Volume volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db (17ce57bb-7310-4deb-a224-a8e9e8cb94db): created successfully Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa37fc2a-f661-4115-a729-96cb8b87a574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (6d5de177-6685-48e3-9400-ce9e2c946cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:55 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d2683a08-be02-4b98-a396-51f13fb95bf8 tempest-VolumesGetTest-1525924872 None] Created volume successfully. Apr 15 10:08:55 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db 1073741824" returned: 0 in 0.518s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:55 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db Apr 15 10:08:55 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (dece10e3-6d04-4f9f-a80f-ac6df520d225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:56 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dbd7a52-6cab-45b2-babe-f17ccc8eb108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db" returned: 0 in 0.490s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.571s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-81614848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1eeb65bddc7464d8f2717e74816a569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:47Z,use_quota=True,user_id='1eac5e41e7cc41e0aeaae42807b1b6e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Creating volume 1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:56 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dbd7a52-6cab-45b2-babe-f17ccc8eb108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1265665054',display_name='tempest-VolumesGetTest-Volume-1187655195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187020b5-b38a-4426-8bcb-551507f024e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c69b291132490889e6d33fbe6ce17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:56Z,use_quota=True,user_id='0d3df5897f2548629dd2cf795ec91b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:56 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb 1073741824 Apr 15 10:08:56 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ebb5b5-7c67-472b-ae61-7e40bf049b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ebb5b5-7c67-472b-ae61-7e40bf049b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6130c9-fdf7-4b82-b986-2aaede5ff5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6130c9-fdf7-4b82-b986-2aaede5ff5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '187020b5-b38a-4426-8bcb-551507f024e0', 'volume_name': 'volume-187020b5-b38a-4426-8bcb-551507f024e0', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154c2691-a650-409a-892f-01cfba70052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154c2691-a650-409a-892f-01cfba70052e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc05d29-087c-4a56-928e-04be81548053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:56 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Volume 187020b5-b38a-4426-8bcb-551507f024e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-187020b5-b38a-4426-8bcb-551507f024e0', 'volume_size': 1} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40040dcd-1ee8-44d1-a777-16449243a80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93c5875-1713-4f52-98ec-f0c9148a45df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:56 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Volume volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db (519967b8-b8f8-4d50-8d43-4bac8e5d86db): created successfully Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93c5875-1713-4f52-98ec-f0c9148a45df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Flow 'volume_create_manager' (450e5233-fb7e-4354-b268-2917bd06398c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b9db958d-b77d-48e6-86ed-c0c6d05d88ee tempest-VolumesActionsTest-712634776 None] Created volume successfully. Apr 15 10:08:56 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb 1073741824" returned: 0 in 0.493s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:56 devstack sudo[86534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb Apr 15 10:08:56 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:57 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb" returned: 0 in 0.428s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.902s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1265665054',display_name='tempest-VolumesGetTest-Volume-1187655195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187020b5-b38a-4426-8bcb-551507f024e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c69b291132490889e6d33fbe6ce17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:56Z,use_quota=True,user_id='0d3df5897f2548629dd2cf795ec91b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Creating volume 187020b5-b38a-4426-8bcb-551507f024e0 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:57 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-187020b5-b38a-4426-8bcb-551507f024e0 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0119bb-e6ed-4fbc-a179-52326ddd863a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac32eb50-97eb-478b-bfa0-c5a88d5b5f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:57 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Volume volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb (1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb): created successfully Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac32eb50-97eb-478b-bfa0-c5a88d5b5f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Flow 'volume_create_manager' (9c053197-013b-478a-8ba0-1a6a987adf51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cab288d8-f1f7-4711-89ea-93de5c421195 tempest-ServersNegativeTestJSON-712166446 None] Created volume successfully. Apr 15 10:08:57 devstack sudo[86537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-187020b5-b38a-4426-8bcb-551507f024e0 1073741824 Apr 15 10:08:57 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Acquiring lock "cinder-519967b8-b8f8-4d50-8d43-4bac8e5d86db-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Lock "cinder-519967b8-b8f8-4d50-8d43-4bac8e5d86db-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Acquiring lock "cinder-quobyte-519967b8-b8f8-4d50-8d43-4bac8e5d86db" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Lock "cinder-quobyte-519967b8-b8f8-4d50-8d43-4bac8e5d86db" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[518dfbbf-8ea6-487d-be62-43b3ceb89f8c]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:57 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db Apr 15 10:08:57 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:58 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-187020b5-b38a-4426-8bcb-551507f024e0 1073741824" returned: 0 in 0.766s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-187020b5-b38a-4426-8bcb-551507f024e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:58 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-187020b5-b38a-4426-8bcb-551507f024e0 Apr 15 10:08:58 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:58 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db" returned: 0 in 0.534s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:58 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db Apr 15 10:08:58 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:58 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-187020b5-b38a-4426-8bcb-551507f024e0" returned: 0 in 0.704s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc05d29-087c-4a56-928e-04be81548053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-187020b5-b38a-4426-8bcb-551507f024e0', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace887df-9011-4e62-99ca-b3b2be3058dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:58 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Volume volume-187020b5-b38a-4426-8bcb-551507f024e0 (187020b5-b38a-4426-8bcb-551507f024e0): created successfully Apr 15 10:08:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace887df-9011-4e62-99ca-b3b2be3058dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (dece10e3-6d04-4f9f-a80f-ac6df520d225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:58 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-98db167c-9244-4f9e-952c-81dbee3cd5f3 tempest-VolumesGetTest-1525924872 None] Created volume successfully. Apr 15 10:08:59 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-519967b8-b8f8-4d50-8d43-4bac8e5d86db" returned: 0 in 0.735s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Lock "cinder-quobyte-519967b8-b8f8-4d50-8d43-4bac8e5d86db" released by "delete_volume" :: held 1.296s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Created reservations ['08eba33b-0248-49cc-b4f7-6cfa50e24c9f', '7eb95c6a-5722-4920-b700-b9ea3b67851a', 'ce4de1f6-1302-4467-8599-5d93e282d8ea', 'a81781ce-cfed-47d5-ba44-131061a03346'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:59 devstack sudo[86553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:08:59 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Flow 'volume_create_manager' (893aef1b-d806-4997-b3cc-05193fc4b947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee75579-4ef9-4891-b82e-b30f8b03dc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee75579-4ef9-4891-b82e-b30f8b03dc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1873633174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cefad8-d226-4ef0-a428-6aac33ca343c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1eeb65bddc7464d8f2717e74816a569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:00Z,use_quota=True,user_id='1eac5e41e7cc41e0aeaae42807b1b6e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58759524-f24b-426f-bec4-12ccb141dc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58759524-f24b-426f-bec4-12ccb141dc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963257c0-4673-4e7d-97ac-709d2c447555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963257c0-4673-4e7d-97ac-709d2c447555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42cefad8-d226-4ef0-a428-6aac33ca343c', 'volume_name': 'volume-42cefad8-d226-4ef0-a428-6aac33ca343c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b1cd6a-ffb3-4469-9b77-1fed02108a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b1cd6a-ffb3-4469-9b77-1fed02108a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f184203b-e4f2-46b9-a7a0-5266a256fb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:59 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Volume 42cefad8-d226-4ef0-a428-6aac33ca343c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42cefad8-d226-4ef0-a428-6aac33ca343c', 'volume_size': 1} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1873633174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cefad8-d226-4ef0-a428-6aac33ca343c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1eeb65bddc7464d8f2717e74816a569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:00Z,use_quota=True,user_id='1eac5e41e7cc41e0aeaae42807b1b6e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Creating volume 42cefad8-d226-4ef0-a428-6aac33ca343c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:59 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-42cefad8-d226-4ef0-a428-6aac33ca343c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:59 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-187020b5-b38a-4426-8bcb-551507f024e0-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.602s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:59 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-42cefad8-d226-4ef0-a428-6aac33ca343c 1073741824 Apr 15 10:08:59 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Deleted volume successfully. Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Lock "cinder-187020b5-b38a-4426-8bcb-551507f024e0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-11e97486-717a-4fcd-91c9-928d3b19177d tempest-VolumesActionsTest-712634776 None] Lock "cinder-519967b8-b8f8-4d50-8d43-4bac8e5d86db-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-quobyte-187020b5-b38a-4426-8bcb-551507f024e0" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-187020b5-b38a-4426-8bcb-551507f024e0" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d057c7-7faa-45fb-a555-a0f521c05de2]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-187020b5-b38a-4426-8bcb-551507f024e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:59 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-187020b5-b38a-4426-8bcb-551507f024e0 Apr 15 10:08:59 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:00 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-42cefad8-d226-4ef0-a428-6aac33ca343c 1073741824" returned: 0 in 0.676s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-42cefad8-d226-4ef0-a428-6aac33ca343c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:00 devstack sudo[86583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-42cefad8-d226-4ef0-a428-6aac33ca343c Apr 15 10:09:00 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:00 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-187020b5-b38a-4426-8bcb-551507f024e0" returned: 0 in 0.621s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-187020b5-b38a-4426-8bcb-551507f024e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:00 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-187020b5-b38a-4426-8bcb-551507f024e0 Apr 15 10:09:00 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:01 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-42cefad8-d226-4ef0-a428-6aac33ca343c" returned: 0 in 0.649s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f184203b-e4f2-46b9-a7a0-5266a256fb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42cefad8-d226-4ef0-a428-6aac33ca343c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54281342-de37-4eaf-99de-1f4874e4fc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:01 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Volume volume-42cefad8-d226-4ef0-a428-6aac33ca343c (42cefad8-d226-4ef0-a428-6aac33ca343c): created successfully Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54281342-de37-4eaf-99de-1f4874e4fc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Flow 'volume_create_manager' (893aef1b-d806-4997-b3cc-05193fc4b947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a11805e1-224d-48b0-bdeb-c0bfbad8d948 tempest-ServersNegativeTestJSON-712166446 None] Created volume successfully. Apr 15 10:09:01 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-187020b5-b38a-4426-8bcb-551507f024e0" returned: 0 in 0.734s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-187020b5-b38a-4426-8bcb-551507f024e0" released by "delete_volume" :: held 1.386s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Created reservations ['e6ee47d3-c595-483c-9bb5-39c5e6859f24', 'f6048306-279e-464e-99e0-282f36611dd8', '08ff801b-99e0-47c5-a7fd-9545f8ea42c3', '596026dc-9e02-4aee-ab4c-31bea79fb4aa'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:01 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:01 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:01 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.569s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Deleted volume successfully. Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=127,cinder:INSERT=41,cinder:UPDATE=184,cinder:DELETE=14 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:09:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-eb64fa32-fe96-4ce2-adcd-7ca45d1ccead tempest-VolumesGetTest-1525924872 None] Lock "cinder-187020b5-b38a-4426-8bcb-551507f024e0-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-17ce57bb-7310-4deb-a224-a8e9e8cb94db-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Lock "cinder-17ce57bb-7310-4deb-a224-a8e9e8cb94db-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:02 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=120,cinder:INSERT=46,cinder:UPDATE=146,cinder:DELETE=15 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:09:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-quobyte-17ce57bb-7310-4deb-a224-a8e9e8cb94db" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-17ce57bb-7310-4deb-a224-a8e9e8cb94db" acquired by "delete_volume" :: waited 0.032s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:02 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cff332f-8c90-4653-bc64-6c8416e80606]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:02 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db Apr 15 10:09:02 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Acquiring lock "cinder-42cefad8-d226-4ef0-a428-6aac33ca343c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Lock "cinder-42cefad8-d226-4ef0-a428-6aac33ca343c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Acquiring lock "cinder-quobyte-42cefad8-d226-4ef0-a428-6aac33ca343c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Lock "cinder-quobyte-42cefad8-d226-4ef0-a428-6aac33ca343c" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:02 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a59b36-ebd4-4be6-95d0-50d73e56ded1]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-42cefad8-d226-4ef0-a428-6aac33ca343c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:02 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-42cefad8-d226-4ef0-a428-6aac33ca343c Apr 15 10:09:02 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:03 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db" returned: 0 in 1.103s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:03 devstack sudo[86617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db Apr 15 10:09:03 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:03 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-42cefad8-d226-4ef0-a428-6aac33ca343c" returned: 0 in 0.788s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-42cefad8-d226-4ef0-a428-6aac33ca343c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:03 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-42cefad8-d226-4ef0-a428-6aac33ca343c Apr 15 10:09:03 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:03 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-17ce57bb-7310-4deb-a224-a8e9e8cb94db" returned: 0 in 0.564s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-17ce57bb-7310-4deb-a224-a8e9e8cb94db" released by "delete_volume" :: held 1.718s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:03 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Created reservations ['5803c05c-8b38-4249-9d90-95738f602751', 'ab49476e-f2a1-4a5b-91ef-9e87b929c238', 'd82a7d2f-bb24-48af-bd44-24695c35d89c', '30b7073c-9cc2-4b2d-b0a3-78c10fbbfbe8'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:03 devstack sudo[86626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:03 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:04 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-42cefad8-d226-4ef0-a428-6aac33ca343c" returned: 0 in 0.616s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Lock "cinder-quobyte-42cefad8-d226-4ef0-a428-6aac33ca343c" released by "delete_volume" :: held 1.430s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Created reservations ['3de01810-e8ec-4358-b7d8-744892070253', 'c45a2f4b-a65b-4140-8e40-f3ef9b39cd33', '4fd755a5-f58e-4e5e-aabf-bcfb7c0e4284', 'ac476395-7143-4257-b25f-4a415f53a30b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:04 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:04 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-5877d08d-a0bd-4a7f-9578-d525a5547255-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Lock "cinder-5877d08d-a0bd-4a7f-9578-d525a5547255-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-quobyte-5877d08d-a0bd-4a7f-9578-d525a5547255" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-5877d08d-a0bd-4a7f-9578-d525a5547255" acquired by "delete_volume" :: waited 0.022s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b11948-1e2c-48ee-9dc0-7914ce822a9c]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:04 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.571s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:04 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Deleted volume successfully. Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7b81049-dc41-425b-897e-d8be2dd883fa tempest-VolumesGetTest-1525924872 None] Lock "cinder-17ce57bb-7310-4deb-a224-a8e9e8cb94db-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:04 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 Apr 15 10:09:04 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:04 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.538s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:04 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Deleted volume successfully. Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81a82b03-9e98-4c51-99a2-9b1c270d12d9 tempest-ServersNegativeTestJSON-712166446 None] Lock "cinder-42cefad8-d226-4ef0-a428-6aac33ca343c-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Acquiring lock "cinder-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Lock "cinder-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Acquiring lock "cinder-quobyte-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Lock "cinder-quobyte-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c992af7-2458-45e4-8fba-4b6b7281a553]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:05 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb Apr 15 10:09:05 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:05 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255" returned: 0 in 0.613s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:05 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255 Apr 15 10:09:05 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:05 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb" returned: 0 in 0.614s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:05 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5877d08d-a0bd-4a7f-9578-d525a5547255" returned: 0 in 0.487s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-5877d08d-a0bd-4a7f-9578-d525a5547255" released by "delete_volume" :: held 1.141s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:05 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb Apr 15 10:09:05 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:05 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Created reservations ['19b3fc58-ff84-41d7-add3-7d1a674ecbf6', '913699a6-87a4-4117-8c84-d31591c11503', 'd2123a55-bd14-4bcd-bcbe-95addcc53a37', 'f4a2b1e3-26b6-4512-97c2-d70d4f980d74'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:05 devstack sudo[86654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:05 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:06 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb" returned: 0 in 0.508s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Lock "cinder-quobyte-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb" released by "delete_volume" :: held 1.144s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:06 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Created reservations ['2f19a1cd-054d-4bd2-a452-c4947f57312d', '0c853282-0fab-4d90-8962-cbb08c309774', '6ab9345c-049b-4df8-849b-bd312b5af209', 'b93692a6-5f30-48cd-93eb-f94d01ab8bd5'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:06 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:06 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.535s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:06 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:06 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Deleted volume successfully. Apr 15 10:09:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b68c47c2-8529-4ae3-b50e-48b7415dfe4a tempest-VolumesGetTest-1525924872 None] Lock "cinder-5877d08d-a0bd-4a7f-9578-d525a5547255-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:07 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.029s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:07 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Deleted volume successfully. Apr 15 10:09:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ac986f91-8013-46dc-98a2-8ca18a5c454a tempest-ServersNegativeTestJSON-712166446 None] Lock "cinder-1f82a0d4-fad7-4fcd-8c3d-9f5c4f183ffb-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (72ac2c94-0af0-4112-ab8d-c3edc1799634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef09231-5903-4357-bef7-21b4c0e7963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef09231-5903-4357-bef7-21b4c0e7963f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1871387441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5bcf69e-6642-43a1-ba78-045ffae6de36,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88c69b291132490889e6d33fbe6ce17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:08Z,use_quota=True,user_id='0d3df5897f2548629dd2cf795ec91b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8caee760-14a6-40da-aa4b-d086bfb5c516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8caee760-14a6-40da-aa4b-d086bfb5c516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eaedcb3-0ece-4c29-a2b9-5d339de3294f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:08 devstack cinder-volume[83167]: DEBUG cinder.image.glance [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Creating Keystone auth plugin from conf {{(pid=83167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 10:09:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eaedcb3-0ece-4c29-a2b9-5d339de3294f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5bcf69e-6642-43a1-ba78-045ffae6de36', 'volume_name': 'volume-f5bcf69e-6642-43a1-ba78-045ffae6de36', 'volume_size': 1, 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3172424652674ff0ab6b0aa4f6bd806f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '634bcf17-826a-4375-a99f-9379442b55d9', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/634bcf17-826a-4375-a99f-9379442b55d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c5d07d-27e0-4e68-89bf-641f64f2e2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c5d07d-27e0-4e68-89bf-641f64f2e2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f907fc4-7478-4553-8a2e-43005fb737de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:08 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Volume f5bcf69e-6642-43a1-ba78-045ffae6de36: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5bcf69e-6642-43a1-ba78-045ffae6de36', 'volume_size': 1, 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3172424652674ff0ab6b0aa4f6bd806f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '634bcf17-826a-4375-a99f-9379442b55d9', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/634bcf17-826a-4375-a99f-9379442b55d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 10:09:08 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Trying to clone f5bcf69e-6642-43a1-ba78-045ffae6de36 from image 634bcf17-826a-4375-a99f-9379442b55d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]). {{(pid=83167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 10:09:09 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 10:09:09 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Image download 20.69 MB at 20.69 MB/s Apr 15 10:09:09 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1076cff-27cb-4e8f-a311-f23a829cac48]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:09 devstack sudo[86758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD Apr 15 10:09:09 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:10 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD" returned: 0 in 1.501s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:10 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Temporary image 634bcf17-826a-4375-a99f-9379442b55d9 is fetched for user 0d3df5897f2548629dd2cf795ec91b79. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 10:09:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e16298-8f39-44d2-88a3-2a54c7a11fc2]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:11 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD Apr 15 10:09:11 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:11 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1871387441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5bcf69e-6642-43a1-ba78-045ffae6de36,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88c69b291132490889e6d33fbe6ce17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:08Z,use_quota=True,user_id='0d3df5897f2548629dd2cf795ec91b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Creating volume f5bcf69e-6642-43a1-ba78-045ffae6de36 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:11 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:09:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:11 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 1073741824 Apr 15 10:09:11 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:12 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 1073741824" returned: 0 in 1.090s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:12 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 Apr 15 10:09:12 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:13 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36" returned: 0 in 0.429s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Attempting download of 634bcf17-826a-4375-a99f-9379442b55d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}])) to volume f5bcf69e-6642-43a1-ba78-045ffae6de36. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cd74c5-1c86-4615-bbd5-13f1ee098a89]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_1hjrer0i {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:13 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_1hjrer0i Apr 15 10:09:13 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Flow 'volume_create_manager' (ab3cf5a7-cf9f-4d48-944e-9617e6c5bd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df6c6d6-eb1a-472d-99e8-6ca4bcd7bd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df6c6d6-eb1a-472d-99e8-6ca4bcd7bd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1154267745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97eb34b0-f3ed-4348-83bc-88e14cf60b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1727027944e9eb4c10ba17c065f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:14Z,use_quota=True,user_id='a586e56bdbdf4d2f9edba5ae688984ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8d6275-b5ce-4e5c-b223-cb91484e9b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8d6275-b5ce-4e5c-b223-cb91484e9b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e4f83d-acc3-47e1-9c1c-b47b4b26f9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e4f83d-acc3-47e1-9c1c-b47b4b26f9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97eb34b0-f3ed-4348-83bc-88e14cf60b6d', 'volume_name': 'volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255b0d28-9ca9-4fb2-acf0-742fba27e0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255b0d28-9ca9-4fb2-acf0-742fba27e0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa05933c-8002-4ff9-8817-528bdaf24446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:13 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Volume 97eb34b0-f3ed-4348-83bc-88e14cf60b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d', 'volume_size': 1} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1154267745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97eb34b0-f3ed-4348-83bc-88e14cf60b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1727027944e9eb4c10ba17c065f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:14Z,use_quota=True,user_id='a586e56bdbdf4d2f9edba5ae688984ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Creating volume 97eb34b0-f3ed-4348-83bc-88e14cf60b6d {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:13 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:14 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d 1073741824 Apr 15 10:09:14 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:14 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_1hjrer0i" returned: 0 in 0.921s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_1hjrer0i {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:14 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_1hjrer0i Apr 15 10:09:14 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:14 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d 1073741824" returned: 0 in 0.665s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:14 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d Apr 15 10:09:14 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:14 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_1hjrer0i" returned: 1 in 0.602s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_634bcf17-826a-4375-a99f-9379442b55d9_1hjrer0i' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:09:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78538f8-bc9c-4ff7-86c0-79d64e1c1e0f]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:14 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD Apr 15 10:09:14 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:15 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d" returned: 0 in 0.591s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa05933c-8002-4ff9-8817-528bdaf24446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38692c28-fbca-42f4-828d-d729ec2b7fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:15 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Volume volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d (97eb34b0-f3ed-4348-83bc-88e14cf60b6d): created successfully Apr 15 10:09:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38692c28-fbca-42f4-828d-d729ec2b7fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Flow 'volume_create_manager' (ab3cf5a7-cf9f-4d48-944e-9617e6c5bd64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-04bf74c7-0066-4301-89db-dc72f7c19352 tempest-VolumesListAdminTestJSON-1055547327 None] Created volume successfully. Apr 15 10:09:15 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD" returned: 0 in 0.684s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:15 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] 634bcf17-826a-4375-a99f-9379442b55d9 was qcow2, converting to raw {{(pid=83167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 10:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:15 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 Apr 15 10:09:15 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Flow 'volume_create_manager' (756d7672-ef0e-4ecc-b6a6-a2896887cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdeba08c-e108-4965-94b9-39bed2deebc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdeba08c-e108-4965-94b9-39bed2deebc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1512125128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81f0799-e976-42d1-a082-f8b90a450978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1727027944e9eb4c10ba17c065f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:16Z,use_quota=True,user_id='a586e56bdbdf4d2f9edba5ae688984ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9fff4c5-64d2-48af-b89f-337685ebe334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9fff4c5-64d2-48af-b89f-337685ebe334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9e7f33-5094-4b7d-8d48-c755340b430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9e7f33-5094-4b7d-8d48-c755340b430b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a81f0799-e976-42d1-a082-f8b90a450978', 'volume_name': 'volume-a81f0799-e976-42d1-a082-f8b90a450978', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cb645f-e119-48a6-bc39-faecf1aec2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cb645f-e119-48a6-bc39-faecf1aec2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6f1583-78ee-4bd0-ab1d-b3bf4e6a0f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:16 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Volume a81f0799-e976-42d1-a082-f8b90a450978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a81f0799-e976-42d1-a082-f8b90a450978', 'volume_size': 1} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1512125128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81f0799-e976-42d1-a082-f8b90a450978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1727027944e9eb4c10ba17c065f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:16Z,use_quota=True,user_id='a586e56bdbdf4d2f9edba5ae688984ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Creating volume a81f0799-e976-42d1-a082-f8b90a450978 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:16 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a81f0799-e976-42d1-a082-f8b90a450978 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:16 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a81f0799-e976-42d1-a082-f8b90a450978 1073741824 Apr 15 10:09:16 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:16 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36" returned: 0 in 1.394s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_634bcf17-826a-4375-a99f-9379442b55d9_ff24b_rwdevstack@QuobyteHD, size 112.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:09:16 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Converted 112.00 MB image at 80.29 MB/s Apr 15 10:09:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:16 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 1G Apr 15 10:09:16 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:17 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a81f0799-e976-42d1-a082-f8b90a450978 1073741824" returned: 0 in 0.640s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a81f0799-e976-42d1-a082-f8b90a450978 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:17 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a81f0799-e976-42d1-a082-f8b90a450978 Apr 15 10:09:17 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:17 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 1G" returned: 0 in 0.570s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:17 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0504c13-b127-4d99-a0fe-b2757a567aa3]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:17 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 Apr 15 10:09:17 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:17 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a81f0799-e976-42d1-a082-f8b90a450978" returned: 0 in 0.566s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6f1583-78ee-4bd0-ab1d-b3bf4e6a0f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a81f0799-e976-42d1-a082-f8b90a450978', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d660cd4-f6cd-4d4d-aea2-911cfc62927a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:17 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Volume volume-a81f0799-e976-42d1-a082-f8b90a450978 (a81f0799-e976-42d1-a082-f8b90a450978): created successfully Apr 15 10:09:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d660cd4-f6cd-4d4d-aea2-911cfc62927a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Flow 'volume_create_manager' (756d7672-ef0e-4ecc-b6a6-a2896887cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e62cc59f-228c-4d2a-8108-baa800205ff7 tempest-VolumesListAdminTestJSON-1055547327 None] Created volume successfully. Apr 15 10:09:18 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36" returned: 0 in 0.646s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:18 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 Apr 15 10:09:18 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:18 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Flow 'volume_create_manager' (06443016-e9f1-4d99-8d91-d5da6db65480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdc6a06-9b98-4884-b930-5bf8a61a5480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdc6a06-9b98-4884-b930-5bf8a61a5480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-764651971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1727027944e9eb4c10ba17c065f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:19Z,use_quota=True,user_id='a586e56bdbdf4d2f9edba5ae688984ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70461c13-5e16-4fc5-8828-4e6c96e16f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70461c13-5e16-4fc5-8828-4e6c96e16f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de5bcc4-fde7-45d3-b135-e8f46936a231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de5bcc4-fde7-45d3-b135-e8f46936a231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0', 'volume_name': 'volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192dc2d0-f952-443c-afc0-1c7c0c4bb919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192dc2d0-f952-443c-afc0-1c7c0c4bb919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d738aee-1d7f-4f81-b1f7-6981ef2abf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:19 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Volume ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0', 'volume_size': 1} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-764651971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1727027944e9eb4c10ba17c065f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:19Z,use_quota=True,user_id='a586e56bdbdf4d2f9edba5ae688984ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Creating volume ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:19 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:19 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0 1073741824 Apr 15 10:09:19 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:19 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36" returned: 1 in 1.021s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Downloaded image 634bcf17-826a-4375-a99f-9379442b55d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}])) to volume f5bcf69e-6642-43a1-ba78-045ffae6de36 successfully. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Temporary image 634bcf17-826a-4375-a99f-9379442b55d9 for user 0d3df5897f2548629dd2cf795ec91b79 is deleted. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Marking volume f5bcf69e-6642-43a1-ba78-045ffae6de36 as bootable. {{(pid=83167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Copying metadata from image 634bcf17-826a-4375-a99f-9379442b55d9 to f5bcf69e-6642-43a1-ba78-045ffae6de36. {{(pid=83167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Creating volume glance metadata for volume f5bcf69e-6642-43a1-ba78-045ffae6de36 backed by image 634bcf17-826a-4375-a99f-9379442b55d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f907fc4-7478-4553-8a2e-43005fb737de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5bcf69e-6642-43a1-ba78-045ffae6de36', 'volume_size': 1, 'image_id': '634bcf17-826a-4375-a99f-9379442b55d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/634bcf17-826a-4375-a99f-9379442b55d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3172424652674ff0ab6b0aa4f6bd806f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '634bcf17-826a-4375-a99f-9379442b55d9', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/634bcf17-826a-4375-a99f-9379442b55d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711cd1fa-2c45-4777-8762-cf5d96fea24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:19 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Volume volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 (f5bcf69e-6642-43a1-ba78-045ffae6de36): created successfully Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711cd1fa-2c45-4777-8762-cf5d96fea24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (72ac2c94-0af0-4112-ab8d-c3edc1799634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-165d3a5d-03dd-4960-ac29-eadd3fc47665 tempest-VolumesGetTest-1525924872 None] Created volume successfully. Apr 15 10:09:20 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0 1073741824" returned: 0 in 1.170s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:20 devstack sudo[86920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0 Apr 15 10:09:20 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:20 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0" returned: 0 in 0.590s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d738aee-1d7f-4f81-b1f7-6981ef2abf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35217e23-37a9-4687-aa2f-dbd829768186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:20 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Volume volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0 (ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0): created successfully Apr 15 10:09:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35217e23-37a9-4687-aa2f-dbd829768186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Flow 'volume_create_manager' (06443016-e9f1-4d99-8d91-d5da6db65480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2acfa04e-aec6-4300-8436-946f921f2940 tempest-VolumesListAdminTestJSON-1055547327 None] Created volume successfully. Apr 15 10:09:20 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (8a21152d-d60d-4d49-b814-cebd010113cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9434a05e-a94b-4c06-839a-281a26d913ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9434a05e-a94b-4c06-839a-281a26d913ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-437298763',display_name='tempest-VolumesGetTest-Volume-328201432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b864748d-ea21-4a6d-ba05-93666f65be63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c69b291132490889e6d33fbe6ce17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:21Z,use_quota=True,user_id='0d3df5897f2548629dd2cf795ec91b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f306ed9-0bd2-4af8-9756-ca9adbee477d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f306ed9-0bd2-4af8-9756-ca9adbee477d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6286ba83-426d-4b5a-b10e-4dd75d3a0937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6286ba83-426d-4b5a-b10e-4dd75d3a0937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b864748d-ea21-4a6d-ba05-93666f65be63', 'volume_name': 'volume-b864748d-ea21-4a6d-ba05-93666f65be63', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19b2886-d82d-4104-96b2-ea36c4bd9241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19b2886-d82d-4104-96b2-ea36c4bd9241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d71ec70-4e59-4923-b5b7-f978e6c20f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:21 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Volume b864748d-ea21-4a6d-ba05-93666f65be63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b864748d-ea21-4a6d-ba05-93666f65be63', 'volume_size': 1} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-437298763',display_name='tempest-VolumesGetTest-Volume-328201432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b864748d-ea21-4a6d-ba05-93666f65be63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c69b291132490889e6d33fbe6ce17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:21Z,use_quota=True,user_id='0d3df5897f2548629dd2cf795ec91b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Creating volume b864748d-ea21-4a6d-ba05-93666f65be63 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:21 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:09:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b864748d-ea21-4a6d-ba05-93666f65be63 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:21 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b864748d-ea21-4a6d-ba05-93666f65be63 1073741824 Apr 15 10:09:21 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Flow 'volume_create_manager' (27c3ae79-5f9a-4268-9b45-6ae7f2288d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fedbdc-9e9d-42bf-aa4e-265149ac42a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fedbdc-9e9d-42bf-aa4e-265149ac42a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-667242146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408edf59-355a-4da7-88d2-d29226644819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e11a10efc9b4f50967f9fe867f9273f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:22Z,use_quota=True,user_id='898379d8a28f493c8ec7c81e8eb79248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb921b12-e0a8-435e-9142-f4a93b9f5474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb921b12-e0a8-435e-9142-f4a93b9f5474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61689db4-543a-4c53-b569-2d98586fabbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61689db4-543a-4c53-b569-2d98586fabbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408edf59-355a-4da7-88d2-d29226644819', 'volume_name': 'volume-408edf59-355a-4da7-88d2-d29226644819', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae72d611-cc43-4bca-aa38-5a707107df49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae72d611-cc43-4bca-aa38-5a707107df49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:22 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abead214-8bca-4c0c-bb1a-a50f7a8ea6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:22 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Volume 408edf59-355a-4da7-88d2-d29226644819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408edf59-355a-4da7-88d2-d29226644819', 'volume_size': 1} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b864748d-ea21-4a6d-ba05-93666f65be63 1073741824" returned: 0 in 1.116s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b864748d-ea21-4a6d-ba05-93666f65be63 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:22 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b864748d-ea21-4a6d-ba05-93666f65be63 Apr 15 10:09:22 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:22 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b864748d-ea21-4a6d-ba05-93666f65be63" returned: 0 in 0.580s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.616s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-667242146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408edf59-355a-4da7-88d2-d29226644819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e11a10efc9b4f50967f9fe867f9273f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:22Z,use_quota=True,user_id='898379d8a28f493c8ec7c81e8eb79248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Creating volume 408edf59-355a-4da7-88d2-d29226644819 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:22 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-408edf59-355a-4da7-88d2-d29226644819 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d71ec70-4e59-4923-b5b7-f978e6c20f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b864748d-ea21-4a6d-ba05-93666f65be63', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04296ec-49f0-44fb-8075-782cbc0d988a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:22 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Volume volume-b864748d-ea21-4a6d-ba05-93666f65be63 (b864748d-ea21-4a6d-ba05-93666f65be63): created successfully Apr 15 10:09:22 devstack sudo[86932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-408edf59-355a-4da7-88d2-d29226644819 1073741824 Apr 15 10:09:22 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04296ec-49f0-44fb-8075-782cbc0d988a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Flow 'volume_create_manager' (8a21152d-d60d-4d49-b814-cebd010113cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d8938da7-86e3-4174-a368-2e6372f0a3c2 tempest-VolumesGetTest-1525924872 None] Created volume successfully. Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Flow 'volume_create_manager' (d1bb21d1-826d-4195-b8a7-a111a299c1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd3ec8d-6481-4358-a3e0-0d8cef95b40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd3ec8d-6481-4358-a3e0-0d8cef95b40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b2b113-0cac-46c5-8e69-3a22454cb3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be19364263924bbdb160970bec9b6e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:23Z,use_quota=True,user_id='218771cc2c124476b556579b12fd8617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11de5166-6d18-4438-8043-13de0809d59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11de5166-6d18-4438-8043-13de0809d59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc4ecb8-d0fd-4ffc-b986-4399a38cffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc4ecb8-d0fd-4ffc-b986-4399a38cffa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b2b113-0cac-46c5-8e69-3a22454cb3f4', 'volume_name': 'volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3433be07-295e-4895-b976-0a0425c909f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3433be07-295e-4895-b976-0a0425c909f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedb33cc-3ddb-4fe8-8fa3-38fe21b24e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:23 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Volume 08b2b113-0cac-46c5-8e69-3a22454cb3f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4', 'volume_size': 1} Apr 15 10:09:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-b864748d-ea21-4a6d-ba05-93666f65be63-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Lock "cinder-b864748d-ea21-4a6d-ba05-93666f65be63-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-quobyte-b864748d-ea21-4a6d-ba05-93666f65be63" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-b864748d-ea21-4a6d-ba05-93666f65be63" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:23 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e0fc59-5e66-4d4d-988d-7d29a0b06060]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b864748d-ea21-4a6d-ba05-93666f65be63 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:23 devstack sudo[86938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b864748d-ea21-4a6d-ba05-93666f65be63 Apr 15 10:09:23 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:23 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-408edf59-355a-4da7-88d2-d29226644819 1073741824" returned: 0 in 1.057s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-408edf59-355a-4da7-88d2-d29226644819 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:23 devstack sudo[86948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-408edf59-355a-4da7-88d2-d29226644819 Apr 15 10:09:23 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:24 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b864748d-ea21-4a6d-ba05-93666f65be63" returned: 0 in 0.693s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b864748d-ea21-4a6d-ba05-93666f65be63 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:24 devstack sudo[86951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b864748d-ea21-4a6d-ba05-93666f65be63 Apr 15 10:09:24 devstack sudo[86951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:24 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-408edf59-355a-4da7-88d2-d29226644819" returned: 0 in 0.680s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b2b113-0cac-46c5-8e69-3a22454cb3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be19364263924bbdb160970bec9b6e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:23Z,use_quota=True,user_id='218771cc2c124476b556579b12fd8617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Creating volume 08b2b113-0cac-46c5-8e69-3a22454cb3f4 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:24 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abead214-8bca-4c0c-bb1a-a50f7a8ea6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408edf59-355a-4da7-88d2-d29226644819', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497adce9-2619-45aa-a887-ba2c1da9c3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:24 devstack sudo[86955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4 1073741824 Apr 15 10:09:24 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:24 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Volume volume-408edf59-355a-4da7-88d2-d29226644819 (408edf59-355a-4da7-88d2-d29226644819): created successfully Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497adce9-2619-45aa-a887-ba2c1da9c3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Flow 'volume_create_manager' (27c3ae79-5f9a-4268-9b45-6ae7f2288d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c067c182-7ee9-4b11-a525-8273393d963c tempest-ServerRescueNegativeTestJSON-990037834 None] Created volume successfully. Apr 15 10:09:24 devstack sudo[86951]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b864748d-ea21-4a6d-ba05-93666f65be63" returned: 0 in 0.584s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-b864748d-ea21-4a6d-ba05-93666f65be63" released by "delete_volume" :: held 1.336s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Created reservations ['4b4842ad-0f43-428b-9217-26c85f82b278', 'b13b2ad4-f63b-4f12-be7c-a5a3e808f3db', '8b973a00-963e-41af-829d-0f9cd73ef4f8', 'cc964924-6b34-40f7-b92c-4921bb71093f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:24 devstack sudo[86957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:24 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:25 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.707s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:25 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Deleted volume successfully. Apr 15 10:09:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-33bf6335-b6d2-483b-bed4-f82d9d98c78e tempest-VolumesGetTest-1525924872 None] Lock "cinder-b864748d-ea21-4a6d-ba05-93666f65be63-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:25 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4 1073741824" returned: 0 in 1.151s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-f5bcf69e-6642-43a1-ba78-045ffae6de36-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Lock "cinder-f5bcf69e-6642-43a1-ba78-045ffae6de36-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:25 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4 Apr 15 10:09:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Acquiring lock "cinder-quobyte-f5bcf69e-6642-43a1-ba78-045ffae6de36" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:25 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-f5bcf69e-6642-43a1-ba78-045ffae6de36" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:25 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bfbd6b-2405-44e3-bd45-3d1b0fab2db2]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:26 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 Apr 15 10:09:26 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:26 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4" returned: 0 in 0.728s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedb33cc-3ddb-4fe8-8fa3-38fe21b24e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae7e8d6-b36c-4cbb-a4b2-df17b83a365d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:26 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Volume volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4 (08b2b113-0cac-46c5-8e69-3a22454cb3f4): created successfully Apr 15 10:09:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae7e8d6-b36c-4cbb-a4b2-df17b83a365d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Flow 'volume_create_manager' (d1bb21d1-826d-4195-b8a7-a111a299c1bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-89df1d92-4c6d-42b1-9108-0d085cc49db5 tempest-VolumesListAdminTestJSON-415158905 None] Created volume successfully. Apr 15 10:09:27 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36" returned: 0 in 1.017s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:27 devstack sudo[86972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 Apr 15 10:09:27 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Acquiring lock "cinder-08b2b113-0cac-46c5-8e69-3a22454cb3f4-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Lock "cinder-08b2b113-0cac-46c5-8e69-3a22454cb3f4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Acquiring lock "cinder-quobyte-08b2b113-0cac-46c5-8e69-3a22454cb3f4" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Lock "cinder-quobyte-08b2b113-0cac-46c5-8e69-3a22454cb3f4" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1881ca-85c7-461e-b47c-0e60733098ca]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d49dd157-15c0-4028-a2e2-0b8e29051049 tempest-GroupsTest-1018682521 None] Group tempest-Group1-641444422: creating Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "cinder-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "cinder-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d49dd157-15c0-4028-a2e2-0b8e29051049 tempest-GroupsTest-1018682521 None] Group tempest-Group1-641444422: created successfully Apr 15 10:09:27 devstack sudo[86974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4 Apr 15 10:09:27 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d49dd157-15c0-4028-a2e2-0b8e29051049 tempest-GroupsTest-1018682521 None] Create group completed successfully. Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "cinder-quobyte-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "cinder-quobyte-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c071a5c-7ef1-44fb-8dae-dddf485b2a29]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:28 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0 Apr 15 10:09:28 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:28 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36" returned: 1 in 1.129s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:28 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36 Apr 15 10:09:28 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:28 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4" returned: 0 in 0.995s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:28 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4 Apr 15 10:09:28 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:28 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5bcf69e-6642-43a1-ba78-045ffae6de36" returned: 0 in 0.591s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Lock "cinder-quobyte-f5bcf69e-6642-43a1-ba78-045ffae6de36" released by "delete_volume" :: held 2.863s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:28 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0" returned: 0 in 0.895s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Created reservations ['6c9237e9-7684-443e-ae53-742087fee0c2', 'c0d0f520-c754-4bde-b880-ff5f77cd4741', 'bf55c0d3-49ae-4720-be65-dcf7918fe211', '8464eb83-727e-43bd-91a2-6a536d2e7152'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:28 devstack sudo[86992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0 Apr 15 10:09:28 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:28 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:28 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8c0c0fba-7c73-4e14-95d4-44c7bfeed2a0 tempest-GroupsTest-1018682521 None] Group tempest-Group2-76533573: creating Apr 15 10:09:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8c0c0fba-7c73-4e14-95d4-44c7bfeed2a0 tempest-GroupsTest-1018682521 None] Group tempest-Group2-76533573: created successfully Apr 15 10:09:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8c0c0fba-7c73-4e14-95d4-44c7bfeed2a0 tempest-GroupsTest-1018682521 None] Create group completed successfully. Apr 15 10:09:29 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-08b2b113-0cac-46c5-8e69-3a22454cb3f4" returned: 0 in 0.993s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Lock "cinder-quobyte-08b2b113-0cac-46c5-8e69-3a22454cb3f4" released by "delete_volume" :: held 2.031s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:29 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Created reservations ['72749735-4969-4d32-9773-380639f2f435', 'e5802964-9557-4167-902d-82c83f84babb', '84783a86-d86a-49d5-8fe0-f1f83a52b715', '3ef89d4f-df57-4231-a26a-12b803be319b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:29 devstack sudo[87022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:29 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:29 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.950s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:29 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:29 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0" returned: 0 in 1.066s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Deleted volume successfully. Apr 15 10:09:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "cinder-quobyte-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0" released by "delete_volume" :: held 2.026s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b33f56f6-f6f1-48ce-9435-23b49dc67596 tempest-VolumesGetTest-1525924872 None] Lock "cinder-f5bcf69e-6642-43a1-ba78-045ffae6de36-delete_volume" released by "delete_volume" :: held 4.184s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Created reservations ['bd19053b-ea9e-477a-aa33-6eb65afe9606', 'e5ef1085-d6e8-477b-b2dc-1e8889ebbb9f', 'd21bd569-b781-4005-9ad0-db9b154bd924', '4dcd2693-2282-4ef7-a4e1-8f77306df44a'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:30 devstack sudo[87025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:30 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:30 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.581s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Deleted volume successfully. Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034ed999-6eb1-4384-8751-d2fdf377aef8 tempest-VolumesListAdminTestJSON-415158905 None] Lock "cinder-08b2b113-0cac-46c5-8e69-3a22454cb3f4-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Flow 'volume_create_manager' (82138833-2402-4ed4-8b30-5aa675d91dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15f7687-a64b-46b2-85ff-d49444227a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:30 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15f7687-a64b-46b2-85ff-d49444227a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1159840544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7186ff4f-610b-4b9c-806a-e363ff43ced5,host='devstack@QuobyteHD#QuobyteHD',id=19e4efad-a17d-48b6-b3ba-28272a1c4a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef2f727d7e54e038726e4bce20999cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:31Z,use_quota=True,user_id='0a277ab9bc8748e8964d386d36ebab21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6d36192-66f3-4d1e-a1c7-c1779546017d),volume_type_id=f6d36192-66f3-4d1e-a1c7-c1779546017d)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a4cc98-1393-4587-9047-1905e876958e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a4cc98-1393-4587-9047-1905e876958e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ea67f1-a61d-48cb-9df2-813a2eeca225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ea67f1-a61d-48cb-9df2-813a2eeca225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e4efad-a17d-48b6-b3ba-28272a1c4a67', 'volume_name': 'volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7fd4c7-398e-4241-a63a-dfe1e32c6a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7fd4c7-398e-4241-a63a-dfe1e32c6a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b585f3af-ddac-42d1-a836-1bf75500d507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:30 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Volume 19e4efad-a17d-48b6-b3ba-28272a1c4a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67', 'volume_size': 1} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7186ff4f-610b-4b9c-806a-e363ff43ced5,created_at=2026-04-15T08:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1159840544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7186ff4f-610b-4b9c-806a-e363ff43ced5,host='devstack@QuobyteHD#QuobyteHD',id=19e4efad-a17d-48b6-b3ba-28272a1c4a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef2f727d7e54e038726e4bce20999cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:31Z,use_quota=True,user_id='0a277ab9bc8748e8964d386d36ebab21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6d36192-66f3-4d1e-a1c7-c1779546017d),volume_type_id=f6d36192-66f3-4d1e-a1c7-c1779546017d)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Creating volume 19e4efad-a17d-48b6-b3ba-28272a1c4a67 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:30 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.836s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:30 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Deleted volume successfully. Apr 15 10:09:31 devstack sudo[87035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67 1073741824 Apr 15 10:09:31 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d99559e7-d385-4067-9887-b11b96de3df4 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "cinder-ecc4840f-2b0e-4c00-be11-bbb6a3eaf7c0-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "cinder-a81f0799-e976-42d1-a082-f8b90a450978-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "cinder-a81f0799-e976-42d1-a082-f8b90a450978-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "cinder-quobyte-a81f0799-e976-42d1-a082-f8b90a450978" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "cinder-quobyte-a81f0799-e976-42d1-a082-f8b90a450978" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f68f4c8-141a-4047-942d-afda973280b2]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a81f0799-e976-42d1-a082-f8b90a450978 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:31 devstack sudo[87037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a81f0799-e976-42d1-a082-f8b90a450978 Apr 15 10:09:31 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:31 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67 1073741824" returned: 0 in 0.647s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:31 devstack sudo[87042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67 Apr 15 10:09:31 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:31 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a81f0799-e976-42d1-a082-f8b90a450978" returned: 0 in 0.675s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a81f0799-e976-42d1-a082-f8b90a450978 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:32 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a81f0799-e976-42d1-a082-f8b90a450978 Apr 15 10:09:32 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Flow 'volume_create_manager' (19019985-bc09-46cb-86af-aa9e01f29dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a566a46c-31eb-4d44-844a-ce424ca2e156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a566a46c-31eb-4d44-844a-ce424ca2e156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-813784909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f37d11f-9514-4d78-8e6f-293aa0b40701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da9f12541b445da9b4a3f21b5909e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:32Z,use_quota=True,user_id='5cfd9cf7f23c417f987bc52cf58e6a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2819d6-b2f9-42d8-986f-8aa3e2e2fdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2819d6-b2f9-42d8-986f-8aa3e2e2fdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:32 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d043004a-240a-4282-aff3-0e9c4b14d4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d043004a-240a-4282-aff3-0e9c4b14d4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f37d11f-9514-4d78-8e6f-293aa0b40701', 'volume_name': 'volume-2f37d11f-9514-4d78-8e6f-293aa0b40701', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d91283-f438-4573-9695-73a1e759005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d91283-f438-4573-9695-73a1e759005f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2984faaa-06f0-43f2-8b67-c59e78b97b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Volume 2f37d11f-9514-4d78-8e6f-293aa0b40701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f37d11f-9514-4d78-8e6f-293aa0b40701', 'volume_size': 1} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67" returned: 0 in 0.607s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-813784909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f37d11f-9514-4d78-8e6f-293aa0b40701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da9f12541b445da9b4a3f21b5909e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:32Z,use_quota=True,user_id='5cfd9cf7f23c417f987bc52cf58e6a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Creating volume 2f37d11f-9514-4d78-8e6f-293aa0b40701 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:32 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b585f3af-ddac-42d1-a836-1bf75500d507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95d6bac-6738-4a57-b6bd-14d584ec1c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Volume volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67 (19e4efad-a17d-48b6-b3ba-28272a1c4a67): created successfully Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95d6bac-6738-4a57-b6bd-14d584ec1c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:32 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 1073741824 Apr 15 10:09:32 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Flow 'volume_create_manager' (82138833-2402-4ed4-8b30-5aa675d91dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7bfb7dda-da5e-49af-8e6e-a4487903ba6c tempest-GroupsTest-1018682521 None] Created volume successfully. Apr 15 10:09:32 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a81f0799-e976-42d1-a082-f8b90a450978" returned: 0 in 0.528s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "cinder-quobyte-a81f0799-e976-42d1-a082-f8b90a450978" released by "delete_volume" :: held 1.250s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Created reservations ['4503c04b-26ae-4063-adc2-48f2951ab4e4', '747c9816-81d5-4541-82e3-18252e6baea7', 'b7e3b948-d383-4d99-819c-7402f0890f8d', 'c28fecbe-fc61-4fdf-b946-89e664f8fa67'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:32 devstack sudo[87053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:32 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:32 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 1073741824" returned: 0 in 0.530s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:32 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 Apr 15 10:09:32 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:33 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.488s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Deleted volume successfully. Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7d133809-a67b-4657-aafa-2d7cc8e83446 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "cinder-a81f0799-e976-42d1-a082-f8b90a450978-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:33 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701" returned: 0 in 0.496s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2984faaa-06f0-43f2-8b67-c59e78b97b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f37d11f-9514-4d78-8e6f-293aa0b40701', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acd8f09-e055-478f-a67c-847a68457b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:33 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Volume volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 (2f37d11f-9514-4d78-8e6f-293aa0b40701): created successfully Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acd8f09-e055-478f-a67c-847a68457b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Flow 'volume_create_manager' (19019985-bc09-46cb-86af-aa9e01f29dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-512ac2d2-c119-485c-ab84-011c098e45b9 tempest-VolumesSnapshotListTestJSON-2036307678 None] Created volume successfully. Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Acquiring lock "cinder-quobyte-19e4efad-a17d-48b6-b3ba-28272a1c4a67" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Lock "cinder-quobyte-19e4efad-a17d-48b6-b3ba-28272a1c4a67" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec622b99-840c-4d5e-9976-fd61dc149a2d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "cinder-97eb34b0-f3ed-4348-83bc-88e14cf60b6d-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "cinder-97eb34b0-f3ed-4348-83bc-88e14cf60b6d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "cinder-quobyte-97eb34b0-f3ed-4348-83bc-88e14cf60b6d" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "cinder-quobyte-97eb34b0-f3ed-4348-83bc-88e14cf60b6d" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b5a0d2-3b3c-4984-bda1-555d1377b29d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:33 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67 Apr 15 10:09:33 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:33 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d Apr 15 10:09:33 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:34 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67" returned: 0 in 0.581s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:34 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67 Apr 15 10:09:34 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:34 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d" returned: 0 in 0.498s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:34 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d Apr 15 10:09:34 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:34 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-97eb34b0-f3ed-4348-83bc-88e14cf60b6d" returned: 0 in 0.651s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "cinder-quobyte-97eb34b0-f3ed-4348-83bc-88e14cf60b6d" released by "delete_volume" :: held 1.174s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:34 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Created reservations ['86333c9a-69ce-4795-b004-5e08ebcc1f07', '72e51c3b-50c7-4e7a-907a-45cba1d5ce2e', '92d3cdac-1f37-4064-ae4b-623686594048', 'b8b6efcd-16e3-44b4-80c4-8945e15eb25d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:34 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-19e4efad-a17d-48b6-b3ba-28272a1c4a67" returned: 0 in 0.849s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Lock "cinder-quobyte-19e4efad-a17d-48b6-b3ba-28272a1c4a67" released by "delete_volume" :: held 1.503s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Created reservations ['6a723b86-dfbf-4393-82b2-05be7f293e40'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:35 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:35 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] Creating offline snapshot 62355163-6b86-4be9-aae6-519bc34cbea8 of volume 2f37d11f-9514-4d78-8e6f-293aa0b40701 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:09:35 devstack cinder-volume[83167]: WARNING cinder.quota [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1236869162 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1236869162, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:09:35 devstack cinder-volume[83167]: WARNING cinder.quota [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1236869162 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1236869162, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Created reservations ['d0d9fb5d-617e-4e8c-946e-937758afb8ea', 'c38321a0-a5a8-4d57-aad5-ec38f4e406aa', 'caf8dd77-ad8d-423e-8186-883441ee8485', 'b0ee9928-2fd0-40c6-a107-1dffeb312fe4'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89ff64b-e035-4d92-a267-5196f1d7c3d4]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:35 devstack sudo[87144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 Apr 15 10:09:35 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:35 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:35 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-0ba83e91-e56c-4334-91bd-594ce1da62bf tempest-GroupsTest-1018682521 None] Created reservations ['a4ae2eb8-22df-45f3-8456-f71b3a507074'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:35 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ba83e91-e56c-4334-91bd-594ce1da62bf tempest-GroupsTest-1018682521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ba83e91-e56c-4334-91bd-594ce1da62bf tempest-GroupsTest-1018682521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0ba83e91-e56c-4334-91bd-594ce1da62bf tempest-GroupsTest-1018682521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0ba83e91-e56c-4334-91bd-594ce1da62bf tempest-GroupsTest-1018682521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ba83e91-e56c-4334-91bd-594ce1da62bf tempest-GroupsTest-1018682521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ba83e91-e56c-4334-91bd-594ce1da62bf tempest-GroupsTest-1018682521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.012s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:36 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:36 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:36 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:36 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Deleted volume successfully. Apr 15 10:09:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-415d93be-1a5b-4bcd-82ee-ee544e3689a0 tempest-VolumesListAdminTestJSON-1055547327 None] Lock "cinder-97eb34b0-f3ed-4348-83bc-88e14cf60b6d-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:36 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.135s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:36 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:36 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6884b673-215f-4f35-a468-3ef95ad73594 tempest-GroupsTest-1018682521 None] Delete group completed successfully. Apr 15 10:09:36 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701" returned: 0 in 1.629s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:36 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 1G Apr 15 10:09:36 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:37 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ba83e91-e56c-4334-91bd-594ce1da62bf tempest-GroupsTest-1018682521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.213s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:37 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-0ba83e91-e56c-4334-91bd-594ce1da62bf tempest-GroupsTest-1018682521 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:37 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0ba83e91-e56c-4334-91bd-594ce1da62bf tempest-GroupsTest-1018682521 None] Delete group completed successfully. Apr 15 10:09:37 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ef100c38-a704-4f99-ad66-f4094754eb91 tempest-GroupsTest-1018682521 None] Group tempest-GroupsTest-Group-2046091258: creating Apr 15 10:09:37 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ef100c38-a704-4f99-ad66-f4094754eb91 tempest-GroupsTest-1018682521 None] Group tempest-GroupsTest-Group-2046091258: created successfully Apr 15 10:09:37 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ef100c38-a704-4f99-ad66-f4094754eb91 tempest-GroupsTest-1018682521 None] Create group completed successfully. Apr 15 10:09:37 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:37 devstack sudo[87164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:37 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:38 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 1G" returned: 0 in 1.439s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:38 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 Apr 15 10:09:38 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:38 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.511s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:38 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:39 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8" returned: 0 in 0.730s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:39 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 is being set with open permissions: ugo+rw Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:39 devstack sudo[87172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 Apr 15 10:09:39 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Flow 'volume_create_manager' (6b8e76ec-b65f-4956-a5cf-84ba82d4a54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83a9149-c5b9-4566-822c-c8bc18522a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83a9149-c5b9-4566-822c-c8bc18522a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-720104846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8bc0b2b8-4143-4d54-854f-73a1c8abb736,host='devstack@QuobyteHD#QuobyteHD',id=d224c4f9-1dc9-43c3-b117-288e94a6025a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef2f727d7e54e038726e4bce20999cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:39Z,use_quota=True,user_id='0a277ab9bc8748e8964d386d36ebab21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64329fbe-2caf-49e4-a936-b73fe66290ca),volume_type_id=64329fbe-2caf-49e4-a936-b73fe66290ca)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154ffd3e-6c4a-422d-bf0c-1f6fd6fdbdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154ffd3e-6c4a-422d-bf0c-1f6fd6fdbdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cb842f-1754-4d4a-929f-22be045b8ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cb842f-1754-4d4a-929f-22be045b8ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd224c4f9-1dc9-43c3-b117-288e94a6025a', 'volume_name': 'volume-d224c4f9-1dc9-43c3-b117-288e94a6025a', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f88969b-4b52-41b6-8488-9d928c964294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f88969b-4b52-41b6-8488-9d928c964294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f154203a-aa23-4ec7-81cf-68759f6805ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:39 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Volume d224c4f9-1dc9-43c3-b117-288e94a6025a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d224c4f9-1dc9-43c3-b117-288e94a6025a', 'volume_size': 1} Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:39 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8" returned: 0 in 0.602s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:39 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.info Apr 15 10:09:39 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:40 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.info" returned: 0 in 0.829s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:40 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.info is being set with open permissions: ugo+rw Apr 15 10:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:40 devstack sudo[87232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.info Apr 15 10:09:40 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Acquiring lock "cinder-408edf59-355a-4da7-88d2-d29226644819-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Lock "cinder-408edf59-355a-4da7-88d2-d29226644819-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Acquiring lock "cinder-quobyte-408edf59-355a-4da7-88d2-d29226644819" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:41 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.info" returned: 0 in 0.933s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.389s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Lock "cinder-quobyte-408edf59-355a-4da7-88d2-d29226644819" acquired by "delete_volume" :: waited 0.074s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.034s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8bc0b2b8-4143-4d54-854f-73a1c8abb736,created_at=2026-04-15T08:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-720104846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8bc0b2b8-4143-4d54-854f-73a1c8abb736,host='devstack@QuobyteHD#QuobyteHD',id=d224c4f9-1dc9-43c3-b117-288e94a6025a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef2f727d7e54e038726e4bce20999cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:39Z,use_quota=True,user_id='0a277ab9bc8748e8964d386d36ebab21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64329fbe-2caf-49e4-a936-b73fe66290ca),volume_type_id=64329fbe-2caf-49e4-a936-b73fe66290ca)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Creating volume d224c4f9-1dc9-43c3-b117-288e94a6025a {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:41 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d224c4f9-1dc9-43c3-b117-288e94a6025a 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cc7e5c-85b6-4448-9ae5-cb35309bf038]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:41 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d224c4f9-1dc9-43c3-b117-288e94a6025a 1073741824 Apr 15 10:09:41 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-408edf59-355a-4da7-88d2-d29226644819 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:41 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b6a16129-ae31-4d64-b9b8-71d5614f1972 tempest-VolumesSnapshotListTestJSON-2036307678 None] Create snapshot completed successfully Apr 15 10:09:41 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-408edf59-355a-4da7-88d2-d29226644819 Apr 15 10:09:41 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:42 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-408edf59-355a-4da7-88d2-d29226644819" returned: 0 in 0.696s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-408edf59-355a-4da7-88d2-d29226644819 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:42 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-408edf59-355a-4da7-88d2-d29226644819 Apr 15 10:09:42 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:42 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d224c4f9-1dc9-43c3-b117-288e94a6025a 1073741824" returned: 0 in 0.829s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d224c4f9-1dc9-43c3-b117-288e94a6025a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:42 devstack sudo[87248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d224c4f9-1dc9-43c3-b117-288e94a6025a Apr 15 10:09:42 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:43 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-408edf59-355a-4da7-88d2-d29226644819" returned: 0 in 0.849s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Lock "cinder-quobyte-408edf59-355a-4da7-88d2-d29226644819" released by "delete_volume" :: held 1.631s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Created reservations ['47defdaa-1218-48eb-80a0-0f7519268af8', '7afabde8-f6fe-4231-9b6b-f8ace8d480dd', 'a92bf835-1e35-4174-8356-2c3841fe4a71', '203c3375-8564-4c6c-b874-98e6af54fef5'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:43 devstack sudo[87253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:43 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:43 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d224c4f9-1dc9-43c3-b117-288e94a6025a" returned: 0 in 1.055s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.707s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f154203a-aa23-4ec7-81cf-68759f6805ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d224c4f9-1dc9-43c3-b117-288e94a6025a', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994809a5-0e9f-49a1-9e19-c72e728978f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] Creating offline snapshot 4f21172b-a715-456a-bda3-0725afa2476d of volume 2f37d11f-9514-4d78-8e6f-293aa0b40701 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:09:43 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Volume volume-d224c4f9-1dc9-43c3-b117-288e94a6025a (d224c4f9-1dc9-43c3-b117-288e94a6025a): created successfully Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994809a5-0e9f-49a1-9e19-c72e728978f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Flow 'volume_create_manager' (6b8e76ec-b65f-4956-a5cf-84ba82d4a54d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[589bc01f-d621-4e09-9e58-b69935b71163]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:43 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-450fe4f4-3858-49b7-ab59-16406ab05498 tempest-GroupsTest-1018682521 None] Created volume successfully. Apr 15 10:09:43 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 Apr 15 10:09:43 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:44 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.148s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Deleted volume successfully. Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-78dd3483-cd6a-4648-adba-dccf672600f6 tempest-ServerRescueNegativeTestJSON-990037834 None] Lock "cinder-408edf59-355a-4da7-88d2-d29226644819-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:44 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8" returned: 0 in 1.079s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f37d11f-9514-4d78-8e6f-293aa0b40701(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:44 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d 1G Apr 15 10:09:44 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Flow 'volume_create_manager' (92d5c7f4-c84e-4735-bed3-9833d5b4457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc8bdec-9cc7-40bb-b91e-e94c6f8f7a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc8bdec-9cc7-40bb-b91e-e94c6f8f7a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-192884311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8bc0b2b8-4143-4d54-854f-73a1c8abb736,host='devstack@QuobyteHD#QuobyteHD',id=e9fb1aaf-00c2-482a-9a6a-62dd065188f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef2f727d7e54e038726e4bce20999cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:45Z,use_quota=True,user_id='0a277ab9bc8748e8964d386d36ebab21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64329fbe-2caf-49e4-a936-b73fe66290ca),volume_type_id=64329fbe-2caf-49e4-a936-b73fe66290ca)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1c31c5-ef0b-47c9-9daa-0ac02eef4077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1c31c5-ef0b-47c9-9daa-0ac02eef4077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c2c13a-5b53-4368-88c7-46dcbf3d2b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c2c13a-5b53-4368-88c7-46dcbf3d2b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9fb1aaf-00c2-482a-9a6a-62dd065188f9', 'volume_name': 'volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7e37ab-10df-4eaa-8327-40340ec9ed66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7e37ab-10df-4eaa-8327-40340ec9ed66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4842da-4b82-49fa-b8c2-b0dfdd9f758d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:44 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Volume e9fb1aaf-00c2-482a-9a6a-62dd065188f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9', 'volume_size': 1} Apr 15 10:09:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:45 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d 1G" returned: 0 in 0.936s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:45 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d Apr 15 10:09:45 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Flow 'volume_create_manager' (2418ca02-ed33-44dc-90d4-35489a999100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69343508-28b5-4341-90e1-db2d97d02234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69343508-28b5-4341-90e1-db2d97d02234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-117450411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2abb385ed25645be8e2907cd1b63ee51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:46Z,use_quota=True,user_id='9bc848acb48b45d68ccb933de6b30b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a028f6-959a-485b-b404-7a36b2ba5f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a028f6-959a-485b-b404-7a36b2ba5f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b94a15-7d27-4778-9ade-ec54edfd70d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b94a15-7d27-4778-9ade-ec54edfd70d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25', 'volume_name': 'volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34d05cf-025d-40d6-8fff-026cd826e448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34d05cf-025d-40d6-8fff-026cd826e448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a64bd8-e28d-4bbe-8e46-c0d98361be65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:45 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Volume 5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25', 'volume_size': 1} Apr 15 10:09:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:46 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d" returned: 0 in 0.596s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:46 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d is being set with open permissions: ugo+rw Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:46 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d Apr 15 10:09:46 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:46 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d" returned: 0 in 0.500s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.247s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.817s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8bc0b2b8-4143-4d54-854f-73a1c8abb736,created_at=2026-04-15T08:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-192884311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8bc0b2b8-4143-4d54-854f-73a1c8abb736,host='devstack@QuobyteHD#QuobyteHD',id=e9fb1aaf-00c2-482a-9a6a-62dd065188f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef2f727d7e54e038726e4bce20999cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:45Z,use_quota=True,user_id='0a277ab9bc8748e8964d386d36ebab21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64329fbe-2caf-49e4-a936-b73fe66290ca),volume_type_id=64329fbe-2caf-49e4-a936-b73fe66290ca)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Creating volume e9fb1aaf-00c2-482a-9a6a-62dd065188f9 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:46 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:46 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9 1073741824 Apr 15 10:09:46 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c28ef9fe-1657-4e0c-b97e-44c6e1892862 tempest-VolumesSnapshotListTestJSON-2036307678 None] Create snapshot completed successfully Apr 15 10:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:47 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9 1073741824" returned: 0 in 0.603s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:47 devstack sudo[87312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9 Apr 15 10:09:47 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:47 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9" returned: 0 in 0.426s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.039s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-117450411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2abb385ed25645be8e2907cd1b63ee51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:46Z,use_quota=True,user_id='9bc848acb48b45d68ccb933de6b30b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Creating volume 5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:47 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4842da-4b82-49fa-b8c2-b0dfdd9f758d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96d354a-f83d-4a9b-bc38-87949464c3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:47 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25 1073741824 Apr 15 10:09:47 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:47 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Volume volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9 (e9fb1aaf-00c2-482a-9a6a-62dd065188f9): created successfully Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96d354a-f83d-4a9b-bc38-87949464c3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Flow 'volume_create_manager' (92d5c7f4-c84e-4735-bed3-9833d5b4457b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:47 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6b975df3-fa09-4571-ac74-c8ec20ce3d07 tempest-GroupsTest-1018682521 None] Created volume successfully. Apr 15 10:09:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-072a796f-de4a-464a-b613-b551949b379d tempest-GroupsTest-1018682521 None] Update group completed successfully. Apr 15 10:09:48 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25 1073741824" returned: 0 in 0.586s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:48 devstack sudo[87320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25 Apr 15 10:09:48 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:48 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25" returned: 0 in 0.425s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.821s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] Creating offline snapshot 01d0ac17-df88-46b7-898b-9c47e4d04ce3 of volume 2f37d11f-9514-4d78-8e6f-293aa0b40701 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a64bd8-e28d-4bbe-8e46-c0d98361be65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422d9759-9b77-416f-9a43-596e1c2a067d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:48 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abedc30-628b-4667-96e5-6c59908cefce]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:48 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Volume volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25 (5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25): created successfully Apr 15 10:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422d9759-9b77-416f-9a43-596e1c2a067d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Flow 'volume_create_manager' (2418ca02-ed33-44dc-90d4-35489a999100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-00839e47-9a83-4df9-ab78-b794e5b96b8d tempest-VolumesTransfersTest-812074496 None] Created volume successfully. Apr 15 10:09:48 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d Apr 15 10:09:48 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:49 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d" returned: 0 in 0.534s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f37d11f-9514-4d78-8e6f-293aa0b40701(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:49 devstack sudo[87328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 1G Apr 15 10:09:49 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:49 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1e0ed4fb-edf3-4775-aee7-9eff717e6e55 tempest-GroupsTest-1018682521 None] Update group completed successfully. Apr 15 10:09:50 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 1G" returned: 0 in 0.641s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:50 devstack sudo[87333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 Apr 15 10:09:50 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:50 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d4a4a3dc-6315-4277-8b6b-0401460b2648 tempest-VolumesTransfersTest-1793143443 None] Transfer volume completed successfully. Apr 15 10:09:50 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3" returned: 0 in 0.501s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:50 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 is being set with open permissions: ugo+rw Apr 15 10:09:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:50 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 Apr 15 10:09:50 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Acquiring lock "cinder-quobyte-d224c4f9-1dc9-43c3-b117-288e94a6025a" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Lock "cinder-quobyte-d224c4f9-1dc9-43c3-b117-288e94a6025a" acquired by "delete_volume" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:50 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15b4d14-6bbb-4cff-8bbb-bfeee1db795b]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d224c4f9-1dc9-43c3-b117-288e94a6025a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:50 devstack sudo[87341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d224c4f9-1dc9-43c3-b117-288e94a6025a Apr 15 10:09:50 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:51 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3" returned: 0 in 0.467s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:51 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-aa24945e-404d-43a4-91ff-fae779617e6a tempest-VolumesSnapshotListTestJSON-2036307678 None] Create snapshot completed successfully Apr 15 10:09:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Acquiring lock "cinder-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Lock "cinder-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Acquiring lock "cinder-quobyte-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Lock "cinder-quobyte-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:51 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c06034-c8c7-4a82-a4e6-0051977ada2c]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:51 devstack sudo[87352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25 Apr 15 10:09:51 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:51 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d224c4f9-1dc9-43c3-b117-288e94a6025a" returned: 0 in 0.764s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d224c4f9-1dc9-43c3-b117-288e94a6025a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:51 devstack sudo[87377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d224c4f9-1dc9-43c3-b117-288e94a6025a Apr 15 10:09:51 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:51 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25" returned: 0 in 0.546s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:51 devstack sudo[87383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25 Apr 15 10:09:51 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:52 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d224c4f9-1dc9-43c3-b117-288e94a6025a" returned: 0 in 0.494s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Lock "cinder-quobyte-d224c4f9-1dc9-43c3-b117-288e94a6025a" released by "delete_volume" :: held 1.290s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Acquiring lock "cinder-quobyte-e9fb1aaf-00c2-482a-9a6a-62dd065188f9" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Lock "cinder-quobyte-e9fb1aaf-00c2-482a-9a6a-62dd065188f9" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d25aec-e162-41b4-9ea7-dafa5cc32ba4]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:52 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9 Apr 15 10:09:52 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:52 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25" returned: 0 in 0.442s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Lock "cinder-quobyte-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25" released by "delete_volume" :: held 1.015s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Created reservations ['c5c00487-c737-4125-9872-e9c1aac1ec05', '931a86cb-29c9-4710-b4cf-549212d256eb', '85ad3f12-c1af-496d-a98b-072fcba1839b', '470ed7b5-5d24-4875-bd9a-844ac59031a4'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:52 devstack sudo[87389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:52 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:52 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9" returned: 0 in 0.671s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:52 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9 Apr 15 10:09:52 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:52 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.520s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:52 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Deleted volume successfully. Apr 15 10:09:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034f99b9-c912-4c1a-9a0c-e1b454231491 tempest-VolumesTransfersTest-786274602 None] Lock "cinder-5eac42ee-4ae6-4fbb-8ad5-d31d56d0ed25-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "cinder-01d0ac17-df88-46b7-898b-9c47e4d04ce3-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-01d0ac17-df88-46b7-898b-9c47e4d04ce3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "cinder-quobyte-2f37d11f-9514-4d78-8e6f-293aa0b40701" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-2f37d11f-9514-4d78-8e6f-293aa0b40701" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "cinder-quobyte-01d0ac17-df88-46b7-898b-9c47e4d04ce3" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-01d0ac17-df88-46b7-898b-9c47e4d04ce3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Deleting offline snapshot 01d0ac17-df88-46b7-898b-9c47e4d04ce3 of volume 2f37d11f-9514-4d78-8e6f-293aa0b40701 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] snapshot_file for this snap is: volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c75fa12-0b64-4aaa-a09b-0587e98b0832]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:53 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 Apr 15 10:09:53 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:53 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e9fb1aaf-00c2-482a-9a6a-62dd065188f9" returned: 0 in 0.537s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Lock "cinder-quobyte-e9fb1aaf-00c2-482a-9a6a-62dd065188f9" released by "delete_volume" :: held 1.238s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Created reservations ['21126256-433a-4fe9-861c-5362a8f09e16'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:53 devstack cinder-volume[83167]: WARNING cinder.quota [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1217553022 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1217553022, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:09:53 devstack cinder-volume[83167]: WARNING cinder.quota [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1217553022 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1217553022, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Created reservations ['e7125372-e381-4625-8102-9294ca077143', 'd2dc8347-b8b0-40ee-81f7-7065f8ea6554', '550aea45-e59f-4db3-86ca-b0d040acfacf', 'b89effde-661f-4dc3-b629-31603818d603'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Created reservations ['7aebc91b-222b-4f8c-ba5c-95dfd8052057', 'd2fb5a2c-0b8d-44b4-b5b8-4de97dde19d7', 'ac6bd357-f670-4f34-987f-4db6c774c45a', '3a79c097-fcc5-415d-8f69-91ec9c22624f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:53 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:53 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Flow 'volume_create_manager' (9048215c-4e66-4ff8-9256-44fc36e9f642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3b91ba-e89b-4f1c-95eb-a82a41af3599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3b91ba-e89b-4f1c-95eb-a82a41af3599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-171199678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f49e0f-dbc8-436e-9981-458af896c0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2abb385ed25645be8e2907cd1b63ee51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:54Z,use_quota=True,user_id='9bc848acb48b45d68ccb933de6b30b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba84d9be-9e07-45e1-91d8-3d892f5bc18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba84d9be-9e07-45e1-91d8-3d892f5bc18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8952da43-acfa-41e0-afff-607d29db36a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8952da43-acfa-41e0-afff-607d29db36a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2f49e0f-dbc8-436e-9981-458af896c0b2', 'volume_name': 'volume-e2f49e0f-dbc8-436e-9981-458af896c0b2', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a627785c-d4be-4efc-8971-b174a14cd03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a627785c-d4be-4efc-8971-b174a14cd03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:53 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d3aed7-bb73-46f3-a2aa-3d63a35ba796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:53 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Volume e2f49e0f-dbc8-436e-9981-458af896c0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2f49e0f-dbc8-436e-9981-458af896c0b2', 'volume_size': 1} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-171199678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f49e0f-dbc8-436e-9981-458af896c0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2abb385ed25645be8e2907cd1b63ee51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:54Z,use_quota=True,user_id='9bc848acb48b45d68ccb933de6b30b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Creating volume e2f49e0f-dbc8-436e-9981-458af896c0b2 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:53 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2f49e0f-dbc8-436e-9981-458af896c0b2 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3" returned: 0 in 0.600s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f37d11f-9514-4d78-8e6f-293aa0b40701(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:53 devstack sudo[87407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2f49e0f-dbc8-436e-9981-458af896c0b2 1073741824 Apr 15 10:09:53 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33636c1-3f36-4841-a97f-963dd92f7c9d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:53 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d Apr 15 10:09:53 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:54 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.690s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:54 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:54 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f10d6b48-b93e-4649-843f-3c9bfb1bc9c0 tempest-GroupsTest-1018682521 None] Delete group completed successfully. Apr 15 10:09:54 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d" returned: 0 in 0.571s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f37d11f-9514-4d78-8e6f-293aa0b40701(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:54 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 Apr 15 10:09:54 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:54 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2f49e0f-dbc8-436e-9981-458af896c0b2 1073741824" returned: 0 in 0.806s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2f49e0f-dbc8-436e-9981-458af896c0b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:54 devstack sudo[87421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2f49e0f-dbc8-436e-9981-458af896c0b2 Apr 15 10:09:54 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:55 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3" returned: 0 in 0.814s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:55 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3 Apr 15 10:09:55 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:55 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2f49e0f-dbc8-436e-9981-458af896c0b2" returned: 0 in 0.697s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d3aed7-bb73-46f3-a2aa-3d63a35ba796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2f49e0f-dbc8-436e-9981-458af896c0b2', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3caad3-feba-4df4-bc01-3d925889f5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:55 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Volume volume-e2f49e0f-dbc8-436e-9981-458af896c0b2 (e2f49e0f-dbc8-436e-9981-458af896c0b2): created successfully Apr 15 10:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3caad3-feba-4df4-bc01-3d925889f5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Flow 'volume_create_manager' (9048215c-4e66-4ff8-9256-44fc36e9f642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:55 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-bfbb5d6c-a82a-49d8-a988-7641f8557ad0 tempest-VolumesTransfersTest-812074496 None] Created volume successfully. Apr 15 10:09:55 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.01d0ac17-df88-46b7-898b-9c47e4d04ce3" returned: 0 in 0.594s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-01d0ac17-df88-46b7-898b-9c47e4d04ce3" released by "_delete_snapshot" :: held 2.644s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-2f37d11f-9514-4d78-8e6f-293aa0b40701" released by "delete_snapshot" :: held 2.659s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:55 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Created reservations ['8d1a7ca1-7ec3-47d3-a6d7-6d2652f23887', 'e5c34c1f-3d6a-47d1-b59a-8d9d9143dff9', 'a1b588a4-42dd-4412-8933-19cb65bec14d', 'c180b066-87e0-44a9-bd22-2f773ba03432'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Delete snapshot completed successfully. Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e90067bb-92cd-46ae-b08a-2a74c559dc38 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-01d0ac17-df88-46b7-898b-9c47e4d04ce3-delete_snapshot" released by "delete_snapshot" :: held 2.798s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Acquiring lock "cinder-e2f49e0f-dbc8-436e-9981-458af896c0b2-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Lock "cinder-e2f49e0f-dbc8-436e-9981-458af896c0b2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Acquiring lock "cinder-quobyte-e2f49e0f-dbc8-436e-9981-458af896c0b2" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Lock "cinder-quobyte-e2f49e0f-dbc8-436e-9981-458af896c0b2" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9255bc9-339c-4d64-ad84-7e26df61faa9]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2f49e0f-dbc8-436e-9981-458af896c0b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:56 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2f49e0f-dbc8-436e-9981-458af896c0b2 Apr 15 10:09:56 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "cinder-4f21172b-a715-456a-bda3-0725afa2476d-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-4f21172b-a715-456a-bda3-0725afa2476d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "cinder-quobyte-2f37d11f-9514-4d78-8e6f-293aa0b40701" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-2f37d11f-9514-4d78-8e6f-293aa0b40701" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "cinder-quobyte-4f21172b-a715-456a-bda3-0725afa2476d" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-4f21172b-a715-456a-bda3-0725afa2476d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Deleting offline snapshot 4f21172b-a715-456a-bda3-0725afa2476d of volume 2f37d11f-9514-4d78-8e6f-293aa0b40701 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] snapshot_file for this snap is: volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec45301-0571-47c7-8834-bcffbdc76eb4]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:56 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d Apr 15 10:09:56 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:56 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2f49e0f-dbc8-436e-9981-458af896c0b2" returned: 0 in 0.635s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2f49e0f-dbc8-436e-9981-458af896c0b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:56 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2f49e0f-dbc8-436e-9981-458af896c0b2 Apr 15 10:09:56 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:57 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d" returned: 0 in 0.604s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f37d11f-9514-4d78-8e6f-293aa0b40701(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf86f42d-b640-4887-8a6a-11a2a2042513]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:57 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 Apr 15 10:09:57 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:57 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2f49e0f-dbc8-436e-9981-458af896c0b2" returned: 0 in 0.661s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Lock "cinder-quobyte-e2f49e0f-dbc8-436e-9981-458af896c0b2" released by "delete_volume" :: held 1.331s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Created reservations ['355bdc1c-63e4-48ed-9416-4ee5afedb1da', 'a898a3a1-08b9-44c7-9582-c4e7e855911c', 'd89bb570-ab84-4d6e-a3b1-9c95455bd532', '174524c6-dbf3-422a-9b10-2803d3c7f716'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:57 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8" returned: 0 in 0.626s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f37d11f-9514-4d78-8e6f-293aa0b40701(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:57 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:09:57 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:57 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d Apr 15 10:09:57 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:58 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.597s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:58 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:58 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Deleted volume successfully. Apr 15 10:09:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a452a276-b5c0-42c1-bc06-949c9572496c tempest-VolumesTransfersTest-786274602 None] Lock "cinder-e2f49e0f-dbc8-436e-9981-458af896c0b2-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:58 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d" returned: 0 in 0.619s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:58 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d Apr 15 10:09:58 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:58 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.4f21172b-a715-456a-bda3-0725afa2476d" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-4f21172b-a715-456a-bda3-0725afa2476d" released by "_delete_snapshot" :: held 2.453s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-2f37d11f-9514-4d78-8e6f-293aa0b40701" released by "delete_snapshot" :: held 2.476s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:59 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Created reservations ['bdb472db-f353-4940-b219-8c070aa7587c', '1e121bc6-d02c-4f49-a0e5-8fce208561c7', '5340499a-2430-4056-8b31-6b05836e362c', '7d13c3c8-29f3-4ffa-a52f-eda0458c8a25'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Delete snapshot completed successfully. Apr 15 10:09:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b008ff10-1895-4873-917e-ec11dcabcf5a tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-4f21172b-a715-456a-bda3-0725afa2476d-delete_snapshot" released by "delete_snapshot" :: held 2.594s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "cinder-62355163-6b86-4be9-aae6-519bc34cbea8-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-62355163-6b86-4be9-aae6-519bc34cbea8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "cinder-quobyte-2f37d11f-9514-4d78-8e6f-293aa0b40701" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-2f37d11f-9514-4d78-8e6f-293aa0b40701" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "cinder-quobyte-62355163-6b86-4be9-aae6-519bc34cbea8" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-62355163-6b86-4be9-aae6-519bc34cbea8" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Deleting offline snapshot 62355163-6b86-4be9-aae6-519bc34cbea8 of volume 2f37d11f-9514-4d78-8e6f-293aa0b40701 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:09:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] snapshot_file for this snap is: volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:09:59 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e016952d-a8b2-4824-b9f9-7020e3b3a060]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:59 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 Apr 15 10:09:59 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:00 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8" returned: 0 in 0.733s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f37d11f-9514-4d78-8e6f-293aa0b40701(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:00 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df02e85-317b-4558-ab5e-0b6830ff0753]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:00 devstack sudo[87466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 Apr 15 10:10:00 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:01 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701" returned: 0 in 0.637s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:01 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 Apr 15 10:10:01 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:01 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8" returned: 0 in 0.730s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:01 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8 Apr 15 10:10:01 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:02 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701.62355163-6b86-4be9-aae6-519bc34cbea8" returned: 0 in 0.563s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:02 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=153,cinder:INSERT=64,cinder:UPDATE=207,cinder:DELETE=12 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:10:02 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=157,cinder:UPDATE=184,cinder:INSERT=38,cinder:DELETE=17 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:10:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-62355163-6b86-4be9-aae6-519bc34cbea8" released by "_delete_snapshot" :: held 2.755s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-2f37d11f-9514-4d78-8e6f-293aa0b40701" released by "delete_snapshot" :: held 2.773s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:02 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Created reservations ['a6ef0986-bea4-4d2e-9557-c5fda14e60f6', '6a158119-c5a9-4e81-b664-a17e3af4ad93', '43d890ad-f062-4eef-9474-43c3516b12a9', 'b4437531-b3fd-452b-9254-998ca7e2d88a'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:02 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Delete snapshot completed successfully. Apr 15 10:10:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e8de3ddf-eac9-45bd-97ff-608477d60216 tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-62355163-6b86-4be9-aae6-519bc34cbea8-delete_snapshot" released by "delete_snapshot" :: held 2.896s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "cinder-2f37d11f-9514-4d78-8e6f-293aa0b40701-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-2f37d11f-9514-4d78-8e6f-293aa0b40701-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "cinder-quobyte-2f37d11f-9514-4d78-8e6f-293aa0b40701" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-2f37d11f-9514-4d78-8e6f-293aa0b40701" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a874430b-4621-4b83-bf66-752be44888c9]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:03 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 Apr 15 10:10:03 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:03 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701" returned: 0 in 0.629s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:03 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701 Apr 15 10:10:03 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Flow 'volume_create_manager' (0a092aa5-d982-4b94-883a-aed03621ba48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a469f5-ad8c-4bc4-8165-ba25e6f2ada6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a469f5-ad8c-4bc4-8165-ba25e6f2ada6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1746857609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27d34b6ea1fa469f90a9b2739f6ab67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:04Z,use_quota=True,user_id='7954e5fdcab64990bde19a164186abc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5a44af-f405-4021-8489-1cd43779dfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5a44af-f405-4021-8489-1cd43779dfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbd2dc6-1e81-467e-9305-fddbc8c57121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbd2dc6-1e81-467e-9305-fddbc8c57121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840', 'volume_name': 'volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd3e512-ccdc-41e0-88e3-617eecc1bac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd3e512-ccdc-41e0-88e3-617eecc1bac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2f0e4d-413f-4264-a969-414e4f47d289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:04 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Volume 9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840', 'volume_size': 1} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1746857609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27d34b6ea1fa469f90a9b2739f6ab67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:04Z,use_quota=True,user_id='7954e5fdcab64990bde19a164186abc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Creating volume 9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:04 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:04 devstack sudo[87487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840 1073741824 Apr 15 10:10:04 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:04 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2f37d11f-9514-4d78-8e6f-293aa0b40701" returned: 0 in 0.620s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-quobyte-2f37d11f-9514-4d78-8e6f-293aa0b40701" released by "delete_volume" :: held 1.310s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Created reservations ['b47b5e92-e8af-4057-b988-1f2ed37b2ec6', 'f54cd7cb-8794-4156-91e8-dc746f32d44f', '038a4d94-27e7-4f6d-8d49-dad1e165a855', '62d16086-35c6-4de6-8dcf-c1c4210eb36a'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:04 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:04 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:04 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840 1073741824" returned: 0 in 0.677s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:04 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840 Apr 15 10:10:04 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:05 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.653s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:05 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Deleted volume successfully. Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f417e386-25c7-4013-a820-df7260a3a29f tempest-VolumesSnapshotListTestJSON-2036307678 None] Lock "cinder-2f37d11f-9514-4d78-8e6f-293aa0b40701-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:05 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840" returned: 0 in 0.544s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2f0e4d-413f-4264-a969-414e4f47d289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621e9052-1e44-429f-8808-a620e9d02129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:05 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Volume volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840 (9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840): created successfully Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621e9052-1e44-429f-8808-a620e9d02129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Flow 'volume_create_manager' (0a092aa5-d982-4b94-883a-aed03621ba48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:05 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cb9c7dd1-32e3-4a4c-8535-a2a2df27ab8e tempest-VolumesTestJSON-1907358719 None] Created volume successfully. Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Flow 'volume_create_manager' (50f840a2-3374-4eb0-b050-2b7b9dad83e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ad946b-dc4c-4f4e-b679-084f324dcc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ad946b-dc4c-4f4e-b679-084f324dcc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2061533653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7772c1a5-9843-4642-b1fe-cc20d064f92d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ab78ebd8fc4846bee1d9a45b0eedd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:05Z,use_quota=True,user_id='5aa76a2937b24f1b917c33b4e73fd808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb65ba90-44c0-4938-b78e-759a7e00a569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb65ba90-44c0-4938-b78e-759a7e00a569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97bc895-84a4-4f58-bbc1-a1c5e63eb1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97bc895-84a4-4f58-bbc1-a1c5e63eb1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7772c1a5-9843-4642-b1fe-cc20d064f92d', 'volume_name': 'volume-7772c1a5-9843-4642-b1fe-cc20d064f92d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084b2f4c-1942-4367-8416-a2b59d6da414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084b2f4c-1942-4367-8416-a2b59d6da414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbdada2-51df-4585-b434-a3eaf705adf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:05 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Volume 7772c1a5-9843-4642-b1fe-cc20d064f92d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7772c1a5-9843-4642-b1fe-cc20d064f92d', 'volume_size': 1} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2061533653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7772c1a5-9843-4642-b1fe-cc20d064f92d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ab78ebd8fc4846bee1d9a45b0eedd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:05Z,use_quota=True,user_id='5aa76a2937b24f1b917c33b4e73fd808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Creating volume 7772c1a5-9843-4642-b1fe-cc20d064f92d {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:05 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7772c1a5-9843-4642-b1fe-cc20d064f92d 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:05 devstack sudo[87501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7772c1a5-9843-4642-b1fe-cc20d064f92d 1073741824 Apr 15 10:10:05 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:06 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7772c1a5-9843-4642-b1fe-cc20d064f92d 1073741824" returned: 0 in 0.694s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7772c1a5-9843-4642-b1fe-cc20d064f92d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:06 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7772c1a5-9843-4642-b1fe-cc20d064f92d Apr 15 10:10:06 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Flow 'volume_create_manager' (1d9e0b15-ee6e-4166-845d-6515be4c3f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09a9a54-9662-4d93-959a-cb546025bc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09a9a54-9662-4d93-959a-cb546025bc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1641333148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ee69e7-58fa-49e7-b37e-7d1df192249b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27d34b6ea1fa469f90a9b2739f6ab67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:06Z,use_quota=True,user_id='7954e5fdcab64990bde19a164186abc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35adb638-fc6d-4bdb-9660-10d824dde9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35adb638-fc6d-4bdb-9660-10d824dde9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347e74d4-c641-4afa-a43d-c348e8934c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347e74d4-c641-4afa-a43d-c348e8934c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07ee69e7-58fa-49e7-b37e-7d1df192249b', 'volume_name': 'volume-07ee69e7-58fa-49e7-b37e-7d1df192249b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5b0301-362f-491d-9f50-907f71cd2195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5b0301-362f-491d-9f50-907f71cd2195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e251ce2-82f8-42ac-8068-dbe848f52aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:06 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Volume 07ee69e7-58fa-49e7-b37e-7d1df192249b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07ee69e7-58fa-49e7-b37e-7d1df192249b', 'volume_size': 1} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:06 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7772c1a5-9843-4642-b1fe-cc20d064f92d" returned: 0 in 0.669s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.227s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1641333148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ee69e7-58fa-49e7-b37e-7d1df192249b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27d34b6ea1fa469f90a9b2739f6ab67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:06Z,use_quota=True,user_id='7954e5fdcab64990bde19a164186abc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Creating volume 07ee69e7-58fa-49e7-b37e-7d1df192249b {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:06 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-07ee69e7-58fa-49e7-b37e-7d1df192249b 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbdada2-51df-4585-b434-a3eaf705adf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7772c1a5-9843-4642-b1fe-cc20d064f92d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:06 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-07ee69e7-58fa-49e7-b37e-7d1df192249b 1073741824 Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0a8109-81c9-4416-9323-e180bcb2ce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:06 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:06 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Volume volume-7772c1a5-9843-4642-b1fe-cc20d064f92d (7772c1a5-9843-4642-b1fe-cc20d064f92d): created successfully Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0a8109-81c9-4416-9323-e180bcb2ce8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Flow 'volume_create_manager' (50f840a2-3374-4eb0-b050-2b7b9dad83e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7303184f-3c54-4598-b5bb-4f1533b4c626 tempest-VolumesTransfersV355Test-1379980096 None] Created volume successfully. Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Flow 'volume_create_manager' (6f22256b-6db5-452c-a0ef-7967a4493b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc60f20-0e0a-4338-82f1-dbdd257bd596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc60f20-0e0a-4338-82f1-dbdd257bd596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1514885336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9c0b2e6414f078bf0b448d7bc024f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:07Z,use_quota=True,user_id='094ea2f705614e8f82bfbadbb82816d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2565b48b-3370-43de-af73-cceab78f3c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2565b48b-3370-43de-af73-cceab78f3c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6232772c-6437-4d74-a173-9582da9fd516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6232772c-6437-4d74-a173-9582da9fd516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2', 'volume_name': 'volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb8f79b-a03b-4cb1-95c4-1ca40b1f0e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb8f79b-a03b-4cb1-95c4-1ca40b1f0e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff66215a-0206-4b0d-84ed-143d2ac9f54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume 0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2', 'volume_size': 1} Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:07 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-07ee69e7-58fa-49e7-b37e-7d1df192249b 1073741824" returned: 0 in 0.719s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-07ee69e7-58fa-49e7-b37e-7d1df192249b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:07 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-07ee69e7-58fa-49e7-b37e-7d1df192249b Apr 15 10:10:07 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8870ab13-8db4-4735-9765-95b747be1290 tempest-VolumesTransfersV355Test-1531927098 None] Transfer volume completed successfully. Apr 15 10:10:08 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-07ee69e7-58fa-49e7-b37e-7d1df192249b" returned: 0 in 0.502s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1514885336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9c0b2e6414f078bf0b448d7bc024f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:07Z,use_quota=True,user_id='094ea2f705614e8f82bfbadbb82816d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Creating volume 0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:08 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e251ce2-82f8-42ac-8068-dbe848f52aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07ee69e7-58fa-49e7-b37e-7d1df192249b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:08 devstack sudo[87518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 1073741824 Apr 15 10:10:08 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941c6021-9879-4036-93a6-099f218b5b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:08 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Volume volume-07ee69e7-58fa-49e7-b37e-7d1df192249b (07ee69e7-58fa-49e7-b37e-7d1df192249b): created successfully Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941c6021-9879-4036-93a6-099f218b5b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Flow 'volume_create_manager' (1d9e0b15-ee6e-4166-845d-6515be4c3f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0076d7fc-938a-4064-bfe0-ed3743f7ae40 tempest-VolumesTestJSON-1907358719 None] Created volume successfully. Apr 15 10:10:08 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 1073741824" returned: 0 in 0.635s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:08 devstack sudo[87524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 Apr 15 10:10:08 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Flow 'volume_create_manager' (b8ade592-0657-47ec-8a67-6c2272b5f67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4011474c-7bfa-4b2c-9bef-5e3b7b0122c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Acquiring lock "cinder-7772c1a5-9843-4642-b1fe-cc20d064f92d-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4011474c-7bfa-4b2c-9bef-5e3b7b0122c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1102490630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1709d96-40eb-46b3-9382-e790b048cf32,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27d34b6ea1fa469f90a9b2739f6ab67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:09Z,use_quota=True,user_id='7954e5fdcab64990bde19a164186abc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0922ca94-4f84-41cc-92dc-f57eba093810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0922ca94-4f84-41cc-92dc-f57eba093810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d568b2f2-3e4d-430a-900b-1d53370aafcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d568b2f2-3e4d-430a-900b-1d53370aafcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1709d96-40eb-46b3-9382-e790b048cf32', 'volume_name': 'volume-d1709d96-40eb-46b3-9382-e790b048cf32', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef5208c-dc4b-43c7-9cb5-635361b685b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef5208c-dc4b-43c7-9cb5-635361b685b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f76628d-efa4-4591-9ce0-3c2f46422b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:09 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Volume d1709d96-40eb-46b3-9382-e790b048cf32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1709d96-40eb-46b3-9382-e790b048cf32', 'volume_size': 1} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Lock "cinder-7772c1a5-9843-4642-b1fe-cc20d064f92d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Acquiring lock "cinder-quobyte-7772c1a5-9843-4642-b1fe-cc20d064f92d" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Lock "cinder-quobyte-7772c1a5-9843-4642-b1fe-cc20d064f92d" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89fe998-cba6-4e01-a011-8f192c2b9ef7]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7772c1a5-9843-4642-b1fe-cc20d064f92d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:09 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7772c1a5-9843-4642-b1fe-cc20d064f92d Apr 15 10:10:09 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:09 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2" returned: 0 in 0.607s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.142s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1102490630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1709d96-40eb-46b3-9382-e790b048cf32,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27d34b6ea1fa469f90a9b2739f6ab67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:09Z,use_quota=True,user_id='7954e5fdcab64990bde19a164186abc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Creating volume d1709d96-40eb-46b3-9382-e790b048cf32 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:09 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d1709d96-40eb-46b3-9382-e790b048cf32 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff66215a-0206-4b0d-84ed-143d2ac9f54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:09 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d1709d96-40eb-46b3-9382-e790b048cf32 1073741824 Apr 15 10:10:09 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf2280d-c3a4-4189-b02f-08ee22e9b7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:09 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 (0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2): created successfully Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf2280d-c3a4-4189-b02f-08ee22e9b7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Flow 'volume_create_manager' (6f22256b-6db5-452c-a0ef-7967a4493b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-02e48098-454e-42de-b555-68a7412bbeb5 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Created volume successfully. Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:09 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7772c1a5-9843-4642-b1fe-cc20d064f92d" returned: 0 in 0.702s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7772c1a5-9843-4642-b1fe-cc20d064f92d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:10 devstack sudo[87537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7772c1a5-9843-4642-b1fe-cc20d064f92d Apr 15 10:10:10 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:10 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d1709d96-40eb-46b3-9382-e790b048cf32 1073741824" returned: 0 in 0.722s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d1709d96-40eb-46b3-9382-e790b048cf32 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:10 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d1709d96-40eb-46b3-9382-e790b048cf32 Apr 15 10:10:10 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Flow 'volume_create_manager' (e8ce8721-6185-4601-b941-c4da528fe189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6f866f-112d-4cf7-889c-a31fe8a09fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6f866f-112d-4cf7-889c-a31fe8a09fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1661295457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59f7c21-123c-4cc9-805d-90f0ff0b3d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='156e671994ae408e92a3f1967b27cdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:10Z,use_quota=True,user_id='6eb4ad3bee3c4adf9f41fdc0a31a1c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5841fb48-f470-4c3f-ad53-e8cfdbb94995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5841fb48-f470-4c3f-ad53-e8cfdbb94995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb099ec7-f4b5-4744-9047-21b8ded50998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb099ec7-f4b5-4744-9047-21b8ded50998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f59f7c21-123c-4cc9-805d-90f0ff0b3d8e', 'volume_name': 'volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3784851e-aa84-4dce-a8d5-f1234265506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3784851e-aa84-4dce-a8d5-f1234265506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c093eb-8aa3-4ad9-ab1a-22ccc07e22c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:10 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Volume f59f7c21-123c-4cc9-805d-90f0ff0b3d8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e', 'volume_size': 1} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:10 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7772c1a5-9843-4642-b1fe-cc20d064f92d" returned: 0 in 0.535s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Lock "cinder-quobyte-7772c1a5-9843-4642-b1fe-cc20d064f92d" released by "delete_volume" :: held 1.265s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Created reservations ['91f664b4-38ca-4991-affe-dccb3a06f1e6', '1a5ca7f8-91f6-4c45-8874-8bb6932bf2fa', '37f8137a-5afb-41ac-b2f9-944f54df6a79', '6ba8e99d-a187-40ce-9d2c-63c694e4d8ad'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:10 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d1709d96-40eb-46b3-9382-e790b048cf32" returned: 0 in 0.504s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:10 devstack sudo[87543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.933s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:10 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f76628d-efa4-4591-9ce0-3c2f46422b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1709d96-40eb-46b3-9382-e790b048cf32', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082d4179-85ff-4ed2-9ad4-f1617ec53f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Creating offline snapshot 80ee6e58-f54d-439d-89e2-0cb8c7ebec81 of volume 0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:10:10 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Volume volume-d1709d96-40eb-46b3-9382-e790b048cf32 (d1709d96-40eb-46b3-9382-e790b048cf32): created successfully Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082d4179-85ff-4ed2-9ad4-f1617ec53f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Flow 'volume_create_manager' (b8ade592-0657-47ec-8a67-6c2272b5f67e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5622380c-6248-4ea4-b267-a0c77015e3c7]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:10 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b3dd0cc0-e567-43fb-9eb3-6bb1781bad3a tempest-VolumesTestJSON-1907358719 None] Created volume successfully. Apr 15 10:10:10 devstack sudo[87545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 Apr 15 10:10:10 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:11 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.500s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:11 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Deleted volume successfully. Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6fb7666-8a43-4396-a896-5940ffa658c5 tempest-VolumesTransfersV355Test-996285365 None] Lock "cinder-7772c1a5-9843-4642-b1fe-cc20d064f92d-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:11 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2" returned: 0 in 0.579s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:11 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 1G Apr 15 10:10:11 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:11 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 1G" returned: 0 in 0.591s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:11 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 Apr 15 10:10:11 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Flow 'volume_create_manager' (562beea2-fe98-4865-b74c-c240d5e7a462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605c158f-fb05-44d8-a8e7-78546cf3b205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605c158f-fb05-44d8-a8e7-78546cf3b205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1059064963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ea5d9c-a31d-45f4-9214-e648875eb48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ab78ebd8fc4846bee1d9a45b0eedd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:12Z,use_quota=True,user_id='5aa76a2937b24f1b917c33b4e73fd808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af923821-247d-46e8-9f82-60369dea689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af923821-247d-46e8-9f82-60369dea689f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0621748-fff3-45f9-a6dd-2bf46b81f441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0621748-fff3-45f9-a6dd-2bf46b81f441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ea5d9c-a31d-45f4-9214-e648875eb48e', 'volume_name': 'volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e172b2f5-2e8b-45da-bcc9-b8d3c7f86cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e172b2f5-2e8b-45da-bcc9-b8d3c7f86cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe548d7-3240-4b67-8187-417ba41f05b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:11 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Volume d5ea5d9c-a31d-45f4-9214-e648875eb48e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e', 'volume_size': 1} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Acquiring lock "cinder-d1709d96-40eb-46b3-9382-e790b048cf32-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Lock "cinder-d1709d96-40eb-46b3-9382-e790b048cf32-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Acquiring lock "cinder-quobyte-d1709d96-40eb-46b3-9382-e790b048cf32" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Lock "cinder-quobyte-d1709d96-40eb-46b3-9382-e790b048cf32" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13f28b2-d605-4bd4-9878-44679e50c2f0]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d1709d96-40eb-46b3-9382-e790b048cf32 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:12 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d1709d96-40eb-46b3-9382-e790b048cf32 Apr 15 10:10:12 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:12 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81" returned: 0 in 0.559s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:12 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 is being set with open permissions: ugo+rw Apr 15 10:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:12 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 Apr 15 10:10:12 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:12 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d1709d96-40eb-46b3-9382-e790b048cf32" returned: 0 in 0.509s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d1709d96-40eb-46b3-9382-e790b048cf32 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:12 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d1709d96-40eb-46b3-9382-e790b048cf32 Apr 15 10:10:12 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:12 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81" returned: 0 in 0.511s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:12 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d1709d96-40eb-46b3-9382-e790b048cf32" returned: 0 in 0.422s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:12 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.info Apr 15 10:10:12 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Lock "cinder-quobyte-d1709d96-40eb-46b3-9382-e790b048cf32" released by "delete_volume" :: held 0.956s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Created reservations ['2a09b021-06aa-476d-b765-cfa1abecf7d3', '1d8e7abd-57b4-4f38-92e2-bc2baee1964e', '2dd399da-aa1e-4ea5-9898-ecf16dc1f59b', '0cdde529-4983-4252-a5ec-6fd09fd9e23f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:13 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:13 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:13 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.info" returned: 0 in 0.437s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:13 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.info is being set with open permissions: ugo+rw Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:13 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.info Apr 15 10:10:13 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:13 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.491s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:13 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Deleted volume successfully. Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f563f45f-0ef4-4071-ac89-2b09fb61353a tempest-VolumesTestJSON-1907358719 None] Lock "cinder-d1709d96-40eb-46b3-9382-e790b048cf32-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:13 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.info" returned: 0 in 0.479s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.244s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.473s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1661295457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59f7c21-123c-4cc9-805d-90f0ff0b3d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='156e671994ae408e92a3f1967b27cdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:10Z,use_quota=True,user_id='6eb4ad3bee3c4adf9f41fdc0a31a1c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Creating volume f59f7c21-123c-4cc9-805d-90f0ff0b3d8e {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:13 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:13 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e 1073741824 Apr 15 10:10:13 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:13 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f0227db8-bdb8-41b3-a215-5ecd1344a0e1 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Create snapshot completed successfully Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Acquiring lock "cinder-07ee69e7-58fa-49e7-b37e-7d1df192249b-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Lock "cinder-07ee69e7-58fa-49e7-b37e-7d1df192249b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Acquiring lock "cinder-quobyte-07ee69e7-58fa-49e7-b37e-7d1df192249b" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Lock "cinder-quobyte-07ee69e7-58fa-49e7-b37e-7d1df192249b" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada75ef7-7902-49de-9295-323170a9ca37]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-07ee69e7-58fa-49e7-b37e-7d1df192249b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:14 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-07ee69e7-58fa-49e7-b37e-7d1df192249b Apr 15 10:10:14 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:14 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e 1073741824" returned: 0 in 0.510s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:14 devstack sudo[87588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e Apr 15 10:10:14 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:14 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-07ee69e7-58fa-49e7-b37e-7d1df192249b" returned: 0 in 0.563s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-07ee69e7-58fa-49e7-b37e-7d1df192249b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:14 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-07ee69e7-58fa-49e7-b37e-7d1df192249b Apr 15 10:10:14 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:14 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e" returned: 0 in 0.418s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.886s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1059064963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ea5d9c-a31d-45f4-9214-e648875eb48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ab78ebd8fc4846bee1d9a45b0eedd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:12Z,use_quota=True,user_id='5aa76a2937b24f1b917c33b4e73fd808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Creating volume d5ea5d9c-a31d-45f4-9214-e648875eb48e {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:14 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c093eb-8aa3-4ad9-ab1a-22ccc07e22c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:14 devstack sudo[87596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e 1073741824 Apr 15 10:10:14 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b662e496-1e33-422e-8bfa-e2abbd30e7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:14 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Volume volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e (f59f7c21-123c-4cc9-805d-90f0ff0b3d8e): created successfully Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b662e496-1e33-422e-8bfa-e2abbd30e7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Flow 'volume_create_manager' (e8ce8721-6185-4601-b941-c4da528fe189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ed3c45b6-2ee9-43e3-a11b-9a1e33044f18 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Created volume successfully. Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Flow 'volume_create_manager' (4012b32b-cf01-4039-b722-16108b33d1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5280a16-4789-4f0a-9107-8998abc37be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5280a16-4789-4f0a-9107-8998abc37be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469626404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5baa41-129a-4857-a157-92fbcecd7741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9c0b2e6414f078bf0b448d7bc024f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:15Z,use_quota=True,user_id='094ea2f705614e8f82bfbadbb82816d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e0226a-b7b8-46b4-b3e5-4f17dda3782d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e0226a-b7b8-46b4-b3e5-4f17dda3782d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5716613-4efc-464c-843a-9e2a57e7b213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5716613-4efc-464c-843a-9e2a57e7b213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca5baa41-129a-4857-a157-92fbcecd7741', 'volume_name': 'volume-ca5baa41-129a-4857-a157-92fbcecd7741', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784ddb0c-cf6c-4716-9fe3-7dc51b08fa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784ddb0c-cf6c-4716-9fe3-7dc51b08fa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad35b1c-eb2e-4934-b858-63e33e175b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume ca5baa41-129a-4857-a157-92fbcecd7741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca5baa41-129a-4857-a157-92fbcecd7741', 'volume_size': 1} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Flow 'volume_create_manager' (e793d4cd-979e-45ba-ba4a-261c5fcf1ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd4c4da-3071-484e-add8-bf0d6c7c97c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd4c4da-3071-484e-add8-bf0d6c7c97c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038829233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6906a6b-42ea-40dc-95bf-1eda258acdc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9c0b2e6414f078bf0b448d7bc024f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:15Z,use_quota=True,user_id='094ea2f705614e8f82bfbadbb82816d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea3c6ae-1a74-41fc-9904-9b8994cf975a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea3c6ae-1a74-41fc-9904-9b8994cf975a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893aa092-3835-4204-87ec-03fd95ac6c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893aa092-3835-4204-87ec-03fd95ac6c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6906a6b-42ea-40dc-95bf-1eda258acdc3', 'volume_name': 'volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1d2b6b-b4e5-4560-a729-62d700634025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1d2b6b-b4e5-4560-a729-62d700634025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af858380-c61f-4ad2-acad-628c808c5920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume d6906a6b-42ea-40dc-95bf-1eda258acdc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3', 'volume_size': 1} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-07ee69e7-58fa-49e7-b37e-7d1df192249b" returned: 0 in 0.664s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Lock "cinder-quobyte-07ee69e7-58fa-49e7-b37e-7d1df192249b" released by "delete_volume" :: held 1.253s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Created reservations ['54c70530-43cb-4ca5-9318-6de685fea99d', '5872ab71-a3e1-4709-9a20-0082b58ca808', '97cadf3e-bf20-46b9-9c68-1ad7979a9ee1', '7bfb7a1f-2864-4c06-9e91-584389132114'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:15 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e 1073741824" returned: 0 in 0.659s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:15 devstack sudo[87602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:15 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Flow 'volume_create_manager' (fe0af771-c104-4e54-984c-8cf6378a1624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e6c610-0c50-4a3f-9d39-b7edf20f0c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e6c610-0c50-4a3f-9d39-b7edf20f0c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-644443787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04f7ea3-8894-4279-a4dd-98252fa6a5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9c0b2e6414f078bf0b448d7bc024f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:16Z,use_quota=True,user_id='094ea2f705614e8f82bfbadbb82816d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd9c59a-700e-41fa-87d5-0a939101709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd9c59a-700e-41fa-87d5-0a939101709e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934f3f7d-c344-4d1c-b714-82b4d786f775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934f3f7d-c344-4d1c-b714-82b4d786f775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f04f7ea3-8894-4279-a4dd-98252fa6a5cc', 'volume_name': 'volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aeee3af-b278-4f12-a6c2-7b1c678839b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aeee3af-b278-4f12-a6c2-7b1c678839b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105af9a3-6230-4759-9964-6a94e316438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume f04f7ea3-8894-4279-a4dd-98252fa6a5cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc', 'volume_size': 1} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:15 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e Apr 15 10:10:15 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Flow 'volume_create_manager' (30fa538a-8bc8-4353-93f0-733db7c0bc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a5c7b9-b592-4d00-b3cf-113fed7b7636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a5c7b9-b592-4d00-b3cf-113fed7b7636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1967223086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eca5664-ab2c-4dd2-9427-0d88c290c4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9c0b2e6414f078bf0b448d7bc024f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:16Z,use_quota=True,user_id='094ea2f705614e8f82bfbadbb82816d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c79143-41e3-4928-a503-cb103eb90569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c79143-41e3-4928-a503-cb103eb90569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41c4561-142c-430d-bbf3-a5deeef20487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41c4561-142c-430d-bbf3-a5deeef20487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eca5664-ab2c-4dd2-9427-0d88c290c4de', 'volume_name': 'volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4062c7a5-ab6c-45e9-b052-1b8c649903e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4062c7a5-ab6c-45e9-b052-1b8c649903e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57267b0-a38a-44cb-a2ab-9e1daf9c1196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:16 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume 9eca5664-ab2c-4dd2-9427-0d88c290c4de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de', 'volume_size': 1} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Flow 'volume_create_manager' (5c412b9b-c18e-4baa-8603-e12871d1943a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ddd5c7b-46f5-4477-a5a7-be69268af3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:16 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Acquiring lock "cinder-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ddd5c7b-46f5-4477-a5a7-be69268af3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2059071366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfe32fe-1e95-46c4-9238-427b4add2f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9c0b2e6414f078bf0b448d7bc024f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:16Z,use_quota=True,user_id='094ea2f705614e8f82bfbadbb82816d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8a389b-036f-4dbb-8365-83145a5c443a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8a389b-036f-4dbb-8365-83145a5c443a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0b0981-3f11-46f2-9b20-662b59563e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0b0981-3f11-46f2-9b20-662b59563e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cfe32fe-1e95-46c4-9238-427b4add2f26', 'volume_name': 'volume-3cfe32fe-1e95-46c4-9238-427b4add2f26', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258213db-d0bc-4506-9308-7f1edb4ea30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258213db-d0bc-4506-9308-7f1edb4ea30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:16 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a8ac5a-27b0-4d20-8fd8-8a71e9e55ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:16 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume 3cfe32fe-1e95-46c4-9238-427b4add2f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cfe32fe-1e95-46c4-9238-427b4add2f26', 'volume_size': 1} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e" returned: 0 in 0.768s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.267s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469626404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5baa41-129a-4857-a157-92fbcecd7741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9c0b2e6414f078bf0b448d7bc024f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:15Z,use_quota=True,user_id='094ea2f705614e8f82bfbadbb82816d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Creating volume ca5baa41-129a-4857-a157-92fbcecd7741 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:16 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ca5baa41-129a-4857-a157-92fbcecd7741 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe548d7-3240-4b67-8187-417ba41f05b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8f48dd-29c3-48cf-9f61-2d0f1c6168a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:16 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ca5baa41-129a-4857-a157-92fbcecd7741 1073741824 Apr 15 10:10:16 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.935s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Lock "cinder-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Deleted volume successfully. Apr 15 10:10:16 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Volume volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e (d5ea5d9c-a31d-45f4-9214-e648875eb48e): created successfully Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8f48dd-29c3-48cf-9f61-2d0f1c6168a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Flow 'volume_create_manager' (562beea2-fe98-4865-b74c-c240d5e7a462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-74256533-0bcc-471f-8254-02ae08e3b326 tempest-VolumesTransfersV355Test-1379980096 None] Created volume successfully. Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-27f31005-faa5-436b-91d9-9f126cf9ba73 tempest-VolumesTestJSON-1907358719 None] Lock "cinder-07ee69e7-58fa-49e7-b37e-7d1df192249b-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Acquiring lock "cinder-quobyte-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Acquiring lock "cinder-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Lock "cinder-quobyte-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Lock "cinder-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c7a32f-1b48-4509-9bb7-0c0d5a1e3a1d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Acquiring lock "cinder-quobyte-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Lock "cinder-quobyte-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[38034f33-b13a-48e3-b569-14bd1859de39]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:16 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840 Apr 15 10:10:16 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:16 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e Apr 15 10:10:16 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:17 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ca5baa41-129a-4857-a157-92fbcecd7741 1073741824" returned: 0 in 0.580s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ca5baa41-129a-4857-a157-92fbcecd7741 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:17 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ca5baa41-129a-4857-a157-92fbcecd7741 Apr 15 10:10:17 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:17 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840" returned: 0 in 0.538s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:17 devstack sudo[87626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840 Apr 15 10:10:17 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:17 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e" returned: 0 in 0.512s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:17 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e Apr 15 10:10:17 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:17 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ca5baa41-129a-4857-a157-92fbcecd7741" returned: 0 in 0.495s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.141s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038829233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6906a6b-42ea-40dc-95bf-1eda258acdc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9c0b2e6414f078bf0b448d7bc024f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:15Z,use_quota=True,user_id='094ea2f705614e8f82bfbadbb82816d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Creating volume d6906a6b-42ea-40dc-95bf-1eda258acdc3 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:17 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Acquiring lock "cinder-d5ea5d9c-a31d-45f4-9214-e648875eb48e-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:17 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad35b1c-eb2e-4934-b858-63e33e175b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca5baa41-129a-4857-a157-92fbcecd7741', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:17 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3 1073741824 Apr 15 10:10:17 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2b5434-8f38-4ec4-94a7-5088fbef5d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840" returned: 0 in 0.507s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:17 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume volume-ca5baa41-129a-4857-a157-92fbcecd7741 (ca5baa41-129a-4857-a157-92fbcecd7741): created successfully Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2b5434-8f38-4ec4-94a7-5088fbef5d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Flow 'volume_create_manager' (4012b32b-cf01-4039-b722-16108b33d1ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Lock "cinder-d5ea5d9c-a31d-45f4-9214-e648875eb48e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Lock "cinder-quobyte-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840" released by "delete_volume" :: held 1.095s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8fb1ee0d-9eb4-4470-a028-a4ba15c4e68b tempest-CreateVolumesFromSnapshotTest-1065813763 None] Created volume successfully. Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Acquiring lock "cinder-quobyte-d5ea5d9c-a31d-45f4-9214-e648875eb48e" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Lock "cinder-quobyte-d5ea5d9c-a31d-45f4-9214-e648875eb48e" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a90de2e-8871-4fb0-96a7-e340788eed7c]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Created reservations ['77dfacd7-2447-4989-8304-23af1868b108', '5e5542d9-fe74-43d0-8a1f-d61d2037da5a', '35702ed0-bc7c-46d1-8ca7-c1c1b082f434', '069f9dfc-471c-4b47-836c-c1c8585b71e6'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:17 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e Apr 15 10:10:17 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:17 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:17 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:17 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e" returned: 0 in 0.689s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Lock "cinder-quobyte-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e" released by "delete_volume" :: held 1.224s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Created reservations ['d1ca9ad9-9d6c-43bb-9d57-70acd519ffa0', '18686d38-94df-4e38-8ede-f2ab6626c128', '193783ba-902d-4ef6-932f-05f850ee9186', '7fe14ddc-ced4-4b33-a749-86c5bafb2e3d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:17 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:17 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:18 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3 1073741824" returned: 0 in 0.579s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:18 devstack sudo[87644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3 Apr 15 10:10:18 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:18 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e" returned: 0 in 0.587s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:18 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e Apr 15 10:10:18 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:18 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.544s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Deleted volume successfully. Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-74e28cb9-610d-45a3-862b-dd1981abef01 tempest-VolumesTestJSON-1907358719 None] Lock "cinder-9fa6e2ec-ca22-4216-ac5f-3cc6daaa5840-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:18 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.464s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Deleted volume successfully. Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef2483b3-6d55-4240-ace9-542a11911c67 tempest-VolumeQuotasNegativeTestJSON-798537090 None] Lock "cinder-f59f7c21-123c-4cc9-805d-90f0ff0b3d8e-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:18 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3" returned: 0 in 0.531s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.042s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-644443787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04f7ea3-8894-4279-a4dd-98252fa6a5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9c0b2e6414f078bf0b448d7bc024f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:16Z,use_quota=True,user_id='094ea2f705614e8f82bfbadbb82816d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Creating volume f04f7ea3-8894-4279-a4dd-98252fa6a5cc {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:18 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af858380-c61f-4ad2-acad-628c808c5920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947ed05e-a855-47c2-9f70-55de6da8d481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:18 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc 1073741824 Apr 15 10:10:18 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3 (d6906a6b-42ea-40dc-95bf-1eda258acdc3): created successfully Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947ed05e-a855-47c2-9f70-55de6da8d481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:18 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Flow 'volume_create_manager' (e793d4cd-979e-45ba-ba4a-261c5fcf1ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b113f11c-3c4d-41bb-9801-9f15cbd9009f tempest-CreateVolumesFromSnapshotTest-1065813763 None] Created volume successfully. Apr 15 10:10:18 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d5ea5d9c-a31d-45f4-9214-e648875eb48e" returned: 0 in 0.521s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Lock "cinder-quobyte-d5ea5d9c-a31d-45f4-9214-e648875eb48e" released by "delete_volume" :: held 1.151s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Created reservations ['4442871e-099b-4d0d-842f-00171b634100', '2984df67-7176-4065-b9d2-85c38bb3a059', 'b0bf445d-2276-41fa-83a4-3ac91223555c', '158f8ed9-08c6-4fa9-9ffc-cab311cc8983'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:18 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:18 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:19 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc 1073741824" returned: 0 in 0.760s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:19 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.629s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:19 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:19 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc Apr 15 10:10:19 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Deleted volume successfully. Apr 15 10:10:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-01f68065-9fe5-40f0-bfc2-65069589c397 tempest-VolumesTransfersV355Test-996285365 None] Lock "cinder-d5ea5d9c-a31d-45f4-9214-e648875eb48e-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:20 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc" returned: 0 in 0.581s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.997s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1967223086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eca5664-ab2c-4dd2-9427-0d88c290c4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9c0b2e6414f078bf0b448d7bc024f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:16Z,use_quota=True,user_id='094ea2f705614e8f82bfbadbb82816d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Creating volume 9eca5664-ab2c-4dd2-9427-0d88c290c4de {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:20 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:20 devstack sudo[87667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de 1073741824 Apr 15 10:10:20 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105af9a3-6230-4759-9964-6a94e316438a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2557f2d5-e703-4b5c-979a-b93398a22290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:20 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc (f04f7ea3-8894-4279-a4dd-98252fa6a5cc): created successfully Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2557f2d5-e703-4b5c-979a-b93398a22290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Flow 'volume_create_manager' (fe0af771-c104-4e54-984c-8cf6378a1624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-31d9ff62-ba2d-4380-94ba-81e6a147abc2 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Created volume successfully. Apr 15 10:10:20 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de 1073741824" returned: 0 in 0.699s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:20 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de Apr 15 10:10:20 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:21 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de" returned: 0 in 0.572s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.981s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2059071366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfe32fe-1e95-46c4-9238-427b4add2f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9c0b2e6414f078bf0b448d7bc024f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:16Z,use_quota=True,user_id='094ea2f705614e8f82bfbadbb82816d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Creating volume 3cfe32fe-1e95-46c4-9238-427b4add2f26 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:21 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3cfe32fe-1e95-46c4-9238-427b4add2f26 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57267b0-a38a-44cb-a2ab-9e1daf9c1196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281bcc42-d3c1-4f73-b5ed-6dd66751c1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:21 devstack sudo[87675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3cfe32fe-1e95-46c4-9238-427b4add2f26 1073741824 Apr 15 10:10:21 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:21 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de (9eca5664-ab2c-4dd2-9427-0d88c290c4de): created successfully Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281bcc42-d3c1-4f73-b5ed-6dd66751c1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Flow 'volume_create_manager' (30fa538a-8bc8-4353-93f0-733db7c0bc8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:21 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1981cab3-5c1d-4319-826d-ea6830303b77 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Created volume successfully. Apr 15 10:10:22 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3cfe32fe-1e95-46c4-9238-427b4add2f26 1073741824" returned: 0 in 0.734s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3cfe32fe-1e95-46c4-9238-427b4add2f26 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:22 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3cfe32fe-1e95-46c4-9238-427b4add2f26 Apr 15 10:10:22 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e98992be-752f-4f89-b8c1-e12125af2912 tempest-GroupSnapshotsTest-1684095675 None] Group tempest-GroupSnapshotsTest-Group-1021076071: creating Apr 15 10:10:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e98992be-752f-4f89-b8c1-e12125af2912 tempest-GroupSnapshotsTest-1684095675 None] Group tempest-GroupSnapshotsTest-Group-1021076071: created successfully Apr 15 10:10:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e98992be-752f-4f89-b8c1-e12125af2912 tempest-GroupSnapshotsTest-1684095675 None] Create group completed successfully. Apr 15 10:10:22 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3cfe32fe-1e95-46c4-9238-427b4add2f26" returned: 0 in 0.557s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a8ac5a-27b0-4d20-8fd8-8a71e9e55ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cfe32fe-1e95-46c4-9238-427b4add2f26', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5adce23-579a-4c59-9f84-55ac7c0aff24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:22 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Volume volume-3cfe32fe-1e95-46c4-9238-427b4add2f26 (3cfe32fe-1e95-46c4-9238-427b4add2f26): created successfully Apr 15 10:10:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5adce23-579a-4c59-9f84-55ac7c0aff24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Flow 'volume_create_manager' (5c412b9b-c18e-4baa-8603-e12871d1943a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-29965f88-1a95-41ca-a0a6-0a6c0160f630 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Created volume successfully. Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-3cfe32fe-1e95-46c4-9238-427b4add2f26-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-3cfe32fe-1e95-46c4-9238-427b4add2f26-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-quobyte-3cfe32fe-1e95-46c4-9238-427b4add2f26" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-3cfe32fe-1e95-46c4-9238-427b4add2f26" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[127daa1f-ae4f-4c0a-9a5d-a0565318ffc5]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3cfe32fe-1e95-46c4-9238-427b4add2f26 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:23 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3cfe32fe-1e95-46c4-9238-427b4add2f26 Apr 15 10:10:23 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Flow 'volume_create_manager' (160c670e-54b8-45d5-a614-dd72f484772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4338f3a-2e11-4609-b1d0-0a65d4d238a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4338f3a-2e11-4609-b1d0-0a65d4d238a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-427994630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c017dc9-10c1-462e-8a2e-2881daac1ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe451524b9bf470fb61abebc652172bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:24Z,use_quota=True,user_id='15711c84858d473097185712d0ce873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bed3f52-f232-4895-b56e-77fa60cb8cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bed3f52-f232-4895-b56e-77fa60cb8cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1a5bc8-d1ea-48ba-9c4c-b62164dd911a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1a5bc8-d1ea-48ba-9c4c-b62164dd911a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c017dc9-10c1-462e-8a2e-2881daac1ef1', 'volume_name': 'volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31575c60-8f00-4c98-a13b-9fb784803afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31575c60-8f00-4c98-a13b-9fb784803afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16622d43-6bc6-4bc9-a5e7-62b584afaf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:23 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Volume 8c017dc9-10c1-462e-8a2e-2881daac1ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1', 'volume_size': 1} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-427994630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c017dc9-10c1-462e-8a2e-2881daac1ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe451524b9bf470fb61abebc652172bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:24Z,use_quota=True,user_id='15711c84858d473097185712d0ce873e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Creating volume 8c017dc9-10c1-462e-8a2e-2881daac1ef1 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:23 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:23 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3cfe32fe-1e95-46c4-9238-427b4add2f26" returned: 0 in 0.660s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3cfe32fe-1e95-46c4-9238-427b4add2f26 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:23 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 1073741824 Apr 15 10:10:23 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:23 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3cfe32fe-1e95-46c4-9238-427b4add2f26 Apr 15 10:10:23 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Flow 'volume_create_manager' (575bc1c8-ed3b-4277-ac6f-d4ea575c304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6761e461-8730-4760-aef3-4d91fe584dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6761e461-8730-4760-aef3-4d91fe584dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-783932364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17b38f4f-53c7-42e3-9d7b-7031c8f6b92c,host='devstack@QuobyteHD#QuobyteHD',id=9dcb6789-ba96-4231-9943-2c782baf8643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5933ebf5bb8472fa36563cd0009d3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:24Z,use_quota=True,user_id='120e1cfec1a44d7291b7602661878181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86cba6d0-8d35-4d3b-9411-16f7805993bd),volume_type_id=86cba6d0-8d35-4d3b-9411-16f7805993bd)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74757b41-7030-46cd-a933-c03686b9962f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74757b41-7030-46cd-a933-c03686b9962f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46dc728-5c53-49fe-b050-063da6a77534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46dc728-5c53-49fe-b050-063da6a77534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dcb6789-ba96-4231-9943-2c782baf8643', 'volume_name': 'volume-9dcb6789-ba96-4231-9943-2c782baf8643', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d11974de-ebd8-4113-a5a4-64eddbefcecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d11974de-ebd8-4113-a5a4-64eddbefcecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d90317-9854-4fde-b5f9-223db9e32460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Volume 9dcb6789-ba96-4231-9943-2c782baf8643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dcb6789-ba96-4231-9943-2c782baf8643', 'volume_size': 1} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:24 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3cfe32fe-1e95-46c4-9238-427b4add2f26" returned: 0 in 0.576s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-3cfe32fe-1e95-46c4-9238-427b4add2f26" released by "delete_volume" :: held 1.266s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:24 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 1073741824" returned: 0 in 0.640s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Created reservations ['e6228202-35c1-411a-9423-8122fca08d38', '0cc0abce-723c-4c07-b34d-412fcd620356', '0b7e8f57-a4c4-42c2-a201-1267a3b0e239', 'ff5fa634-29b7-485e-a2d9-e9553fb143d3'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:24 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 Apr 15 10:10:24 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:24 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:24 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:24 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1" returned: 0 in 0.477s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.913s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17b38f4f-53c7-42e3-9d7b-7031c8f6b92c,created_at=2026-04-15T08:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-783932364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17b38f4f-53c7-42e3-9d7b-7031c8f6b92c,host='devstack@QuobyteHD#QuobyteHD',id=9dcb6789-ba96-4231-9943-2c782baf8643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5933ebf5bb8472fa36563cd0009d3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:24Z,use_quota=True,user_id='120e1cfec1a44d7291b7602661878181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86cba6d0-8d35-4d3b-9411-16f7805993bd),volume_type_id=86cba6d0-8d35-4d3b-9411-16f7805993bd)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Creating volume 9dcb6789-ba96-4231-9943-2c782baf8643 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:24 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:24 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16622d43-6bc6-4bc9-a5e7-62b584afaf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318cc110-bac1-4a9e-badc-fa376494d28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.506s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:24 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:24 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 1073741824 Apr 15 10:10:24 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Deleted volume successfully. Apr 15 10:10:25 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Volume volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 (8c017dc9-10c1-462e-8a2e-2881daac1ef1): created successfully Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318cc110-bac1-4a9e-badc-fa376494d28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Flow 'volume_create_manager' (160c670e-54b8-45d5-a614-dd72f484772b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8cc57c4e-9244-473f-a0a7-5d6401ced2cb tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-3cfe32fe-1e95-46c4-9238-427b4add2f26-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3992388a-f72a-44c4-b5c3-c0c5c31e60c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Created volume successfully. Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Flow 'volume_create_manager' (aef82463-083c-4fe2-978e-8d420f2218ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f3492c-d2ca-4df2-a762-73b5e74052ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f3492c-d2ca-4df2-a762-73b5e74052ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-969451866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33f13c1-b483-4c46-bd1b-1c187f4016c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed7226bb27e44098c5b850907c49618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:25Z,use_quota=True,user_id='3ee9fa1644e44f04abc82f88231abbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d977e76b-d3a7-4830-b24d-138cce8a312c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d977e76b-d3a7-4830-b24d-138cce8a312c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1512f1-3d06-49a4-85de-001f896df73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1512f1-3d06-49a4-85de-001f896df73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a33f13c1-b483-4c46-bd1b-1c187f4016c1', 'volume_name': 'volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad9c049-afaa-435b-baf9-c00b1ae518fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad9c049-afaa-435b-baf9-c00b1ae518fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c5b3d0-968b-4dd1-9778-ea0191b89c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:25 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Volume a33f13c1-b483-4c46-bd1b-1c187f4016c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1', 'volume_size': 1} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-9eca5664-ab2c-4dd2-9427-0d88c290c4de-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-9eca5664-ab2c-4dd2-9427-0d88c290c4de-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-quobyte-9eca5664-ab2c-4dd2-9427-0d88c290c4de" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-9eca5664-ab2c-4dd2-9427-0d88c290c4de" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a213f447-f4b3-4f14-b03d-9a0c2a8d9268]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:25 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de Apr 15 10:10:25 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:25 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 1073741824" returned: 0 in 0.587s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:25 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 Apr 15 10:10:25 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:25 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de" returned: 0 in 0.656s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:26 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de Apr 15 10:10:26 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:26 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643" returned: 0 in 0.480s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-969451866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33f13c1-b483-4c46-bd1b-1c187f4016c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed7226bb27e44098c5b850907c49618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:25Z,use_quota=True,user_id='3ee9fa1644e44f04abc82f88231abbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Creating volume a33f13c1-b483-4c46-bd1b-1c187f4016c1 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:26 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d90317-9854-4fde-b5f9-223db9e32460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dcb6789-ba96-4231-9943-2c782baf8643', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db92111-1c31-48ba-b58d-a2b329336c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:26 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1 1073741824 Apr 15 10:10:26 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:26 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Volume volume-9dcb6789-ba96-4231-9943-2c782baf8643 (9dcb6789-ba96-4231-9943-2c782baf8643): created successfully Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db92111-1c31-48ba-b58d-a2b329336c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Flow 'volume_create_manager' (575bc1c8-ed3b-4277-ac6f-d4ea575c304b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1d5a36e2-63ac-4fc8-8b17-3bbd1c7ad380 tempest-GroupSnapshotsTest-1684095675 None] Created volume successfully. Apr 15 10:10:26 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9eca5664-ab2c-4dd2-9427-0d88c290c4de" returned: 0 in 0.460s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-9eca5664-ab2c-4dd2-9427-0d88c290c4de" released by "delete_volume" :: held 1.136s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Created reservations ['6e3bec40-5985-43b8-add9-400cbb2bfb62', 'b2278b6a-40d4-4a0c-8c85-b0dc0b9f08c7', 'a3772b0d-7746-42f7-a46f-ac1af9228e66', 'd9a512b3-698c-471f-aa59-ae86bdd259e0'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:26 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:26 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:26 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1 1073741824" returned: 0 in 0.538s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:26 devstack sudo[87733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1 Apr 15 10:10:26 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:26 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.467s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Deleted volume successfully. Apr 15 10:10:27 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1" returned: 0 in 0.414s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-83d3c7a1-d164-4790-a354-74cd554df7d6 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-9eca5664-ab2c-4dd2-9427-0d88c290c4de-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.143s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Creating offline snapshot 7fc09403-45fe-4df6-a5ca-1549cf9cec4f of volume 8c017dc9-10c1-462e-8a2e-2881daac1ef1 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c5b3d0-968b-4dd1-9778-ea0191b89c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4527b972-4c67-4a51-b94c-68a3a23ff742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d547189-bce4-4d20-ac1f-c9fd68bf6c2a]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:27 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Volume volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1 (a33f13c1-b483-4c46-bd1b-1c187f4016c1): created successfully Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4527b972-4c67-4a51-b94c-68a3a23ff742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Flow 'volume_create_manager' (aef82463-083c-4fe2-978e-8d420f2218ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1856ca47-0c34-40b5-a9eb-2f4de457149d tempest-VolumesTransfersV357Test-1806084937 None] Created volume successfully. Apr 15 10:10:27 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 Apr 15 10:10:27 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] GroupSnapshot d7f48730-f6a8-4884-b8fb-488b6e27a558: creating. Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-f04f7ea3-8894-4279-a4dd-98252fa6a5cc-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] Group snapshot d7f48730-f6a8-4884-b8fb-488b6e27a558: creating. {{(pid=83167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-f04f7ea3-8894-4279-a4dd-98252fa6a5cc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-quobyte-f04f7ea3-8894-4279-a4dd-98252fa6a5cc" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-f04f7ea3-8894-4279-a4dd-98252fa6a5cc" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3cd5da-8c09-4177-b062-b2cabee9c3b6]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:27 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc Apr 15 10:10:27 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:27 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1" returned: 0 in 0.556s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:27 devstack sudo[87744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f 1G Apr 15 10:10:27 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-da66a6ff-dcb7-485a-9853-c695ad4d9445 tempest-VolumesTransfersV357Test-392249257 None] Transfer volume completed successfully. Apr 15 10:10:28 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc" returned: 0 in 0.536s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:28 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc Apr 15 10:10:28 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:28 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f 1G" returned: 0 in 0.517s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:28 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f Apr 15 10:10:28 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:28 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f04f7ea3-8894-4279-a4dd-98252fa6a5cc" returned: 0 in 0.502s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-f04f7ea3-8894-4279-a4dd-98252fa6a5cc" released by "delete_volume" :: held 1.064s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Acquiring lock "cinder-a33f13c1-b483-4c46-bd1b-1c187f4016c1-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Created reservations ['304d8443-954e-4107-bf84-99560e580e41', '603fa879-7caa-470c-b7bb-2b2ed65f22d2', '21a665ff-12d2-4107-b0d4-2787a89c36ae', '28f31293-3bf3-411f-a7aa-68c1a8bb5203'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Lock "cinder-a33f13c1-b483-4c46-bd1b-1c187f4016c1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:28 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Acquiring lock "cinder-quobyte-a33f13c1-b483-4c46-bd1b-1c187f4016c1" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f" returned: 0 in 0.592s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:28 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f is being set with open permissions: ugo+rw Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:28 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f Apr 15 10:10:28 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Lock "cinder-quobyte-a33f13c1-b483-4c46-bd1b-1c187f4016c1" acquired by "delete_volume" :: waited 0.040s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:28 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:28 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aab3b5-c815-4b32-930f-71c3999eae43]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:28 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1 Apr 15 10:10:28 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:29 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f" returned: 0 in 0.412s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:29 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.info Apr 15 10:10:29 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:29 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1" returned: 0 in 0.487s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:29 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.530s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:29 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1 Apr 15 10:10:29 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Deleted volume successfully. Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0ed3d20e-680a-4ea2-840f-a5662ba4c625 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-f04f7ea3-8894-4279-a4dd-98252fa6a5cc-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:29 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.info" returned: 0 in 0.462s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:29 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.info is being set with open permissions: ugo+rw Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:29 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.info Apr 15 10:10:29 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-d6906a6b-42ea-40dc-95bf-1eda258acdc3-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-d6906a6b-42ea-40dc-95bf-1eda258acdc3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:29 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-a33f13c1-b483-4c46-bd1b-1c187f4016c1" returned: 0 in 0.458s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-quobyte-d6906a6b-42ea-40dc-95bf-1eda258acdc3" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Lock "cinder-quobyte-a33f13c1-b483-4c46-bd1b-1c187f4016c1" released by "delete_volume" :: held 0.978s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-d6906a6b-42ea-40dc-95bf-1eda258acdc3" acquired by "delete_volume" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f993c5-4641-4079-bb56-66a9925903a3]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Created reservations ['bfdce5b3-e9f5-45e5-954f-d32e03b7ec9b', '3b927d4f-f408-49df-82df-e1327e7d7f8c', '1b860444-4eca-47fa-bd03-b54007bfe427', 'c33b22f1-e5bf-43fe-919d-e73e84656abe'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:29 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3 Apr 15 10:10:29 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:29 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:29 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:30 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.info" returned: 0 in 0.492s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.092s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.639s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b36e0933-c8a2-4da8-b977-680ccca2a0b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Create snapshot completed successfully Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] Creating offline snapshot b85ae923-3625-47ec-8786-fd846d5b86e2 of volume 9dcb6789-ba96-4231-9943-2c782baf8643 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ef82d0-5a8c-4f4e-915d-d089ae8a3556]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:30 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 Apr 15 10:10:30 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:30 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3" returned: 0 in 0.501s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:30 devstack sudo[87790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3 Apr 15 10:10:30 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:30 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.470s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Deleted volume successfully. Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f4b96cfc-9ab1-455b-940e-008695b49b7e tempest-VolumesTransfersV357Test-1787183396 None] Lock "cinder-a33f13c1-b483-4c46-bd1b-1c187f4016c1-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:30 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643" returned: 0 in 0.513s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:30 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d6906a6b-42ea-40dc-95bf-1eda258acdc3" returned: 0 in 0.431s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:30 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 1G Apr 15 10:10:30 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-d6906a6b-42ea-40dc-95bf-1eda258acdc3" released by "delete_volume" :: held 0.961s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Created reservations ['4dc212d8-44bc-4651-83c0-40bbfeb99b0e', '6ba69df6-7d72-401c-a330-abe1238dd7af', '9788af78-a63e-49c0-a01f-1a52e150b66a', '613e56cb-8921-4ee9-83f7-18ce505389f9'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:30 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:30 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Flow 'volume_create_manager' (14eba128-5b3c-47b4-b375-079a7ccf4630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c2b54b-1b00-48f8-9ac2-930de7422daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c2b54b-1b00-48f8-9ac2-930de7422daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1977508577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a245f7-26b6-4148-bf12-7eb7474e0ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed7226bb27e44098c5b850907c49618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:31Z,use_quota=True,user_id='3ee9fa1644e44f04abc82f88231abbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dee7bc9-eacc-4414-b67b-396db5b3c974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dee7bc9-eacc-4414-b67b-396db5b3c974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99548413-ff22-4a30-935c-1c7df0bfe7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99548413-ff22-4a30-935c-1c7df0bfe7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a245f7-26b6-4148-bf12-7eb7474e0ce2', 'volume_name': 'volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c5723b-7e5e-43ca-a97c-b0cb76783373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c5723b-7e5e-43ca-a97c-b0cb76783373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c53d0c6-285c-41ac-8810-83d2ee9e7094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Volume 12a245f7-26b6-4148-bf12-7eb7474e0ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2', 'volume_size': 1} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:31 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.526s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Deleted volume successfully. Apr 15 10:10:31 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 1G" returned: 0 in 0.677s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dcb6789-ba96-4231-9943-2c782baf8643 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-473eb28e-0129-4a66-a689-d5ad7d164d30 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-d6906a6b-42ea-40dc-95bf-1eda258acdc3-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:31 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dcb6789-ba96-4231-9943-2c782baf8643 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 Apr 15 10:10:31 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Acquiring lock "cinder-7fc09403-45fe-4df6-a5ca-1549cf9cec4f-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "cinder-7fc09403-45fe-4df6-a5ca-1549cf9cec4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Acquiring lock "cinder-quobyte-8c017dc9-10c1-462e-8a2e-2881daac1ef1" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "cinder-quobyte-8c017dc9-10c1-462e-8a2e-2881daac1ef1" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Acquiring lock "cinder-quobyte-7fc09403-45fe-4df6-a5ca-1549cf9cec4f" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "cinder-quobyte-7fc09403-45fe-4df6-a5ca-1549cf9cec4f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Deleting offline snapshot 7fc09403-45fe-4df6-a5ca-1549cf9cec4f of volume 8c017dc9-10c1-462e-8a2e-2881daac1ef1 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] snapshot_file for this snap is: volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bdbfc7-b44b-4b90-8ac5-885af9a477b4]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:31 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f Apr 15 10:10:31 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-ca5baa41-129a-4857-a157-92fbcecd7741-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-ca5baa41-129a-4857-a157-92fbcecd7741-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:31 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dcb6789-ba96-4231-9943-2c782baf8643 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2" returned: 0 in 0.512s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:31 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:31 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-quobyte-ca5baa41-129a-4857-a157-92fbcecd7741" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:31 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-ca5baa41-129a-4857-a157-92fbcecd7741" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cc5cee-2216-4a0b-8918-96de611da052]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ca5baa41-129a-4857-a157-92fbcecd7741 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:31 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ca5baa41-129a-4857-a157-92fbcecd7741 Apr 15 10:10:31 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:32 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f" returned: 0 in 0.589s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[31917dad-bd09-4480-837e-adf66d8ce343]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:32 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 Apr 15 10:10:32 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:32 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2" returned: 0 in 0.439s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:32 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.info Apr 15 10:10:32 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:32 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ca5baa41-129a-4857-a157-92fbcecd7741" returned: 0 in 0.526s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ca5baa41-129a-4857-a157-92fbcecd7741 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:32 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ca5baa41-129a-4857-a157-92fbcecd7741 Apr 15 10:10:32 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:32 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1" returned: 0 in 0.507s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:32 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f Apr 15 10:10:32 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:32 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.info" returned: 0 in 0.476s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:32 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:32 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.info Apr 15 10:10:32 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:32 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ca5baa41-129a-4857-a157-92fbcecd7741" returned: 0 in 0.441s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-ca5baa41-129a-4857-a157-92fbcecd7741" released by "delete_volume" :: held 0.999s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Created reservations ['7d45fc87-61e7-435d-b59e-f007262dd93b', 'eed76be2-f21c-45ee-9ffc-07153d45ea96', '2353d04c-ba57-4272-8341-94e4115a0ee0', 'efe69572-b883-4c81-96bf-4a8df1a354f9'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:33 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:33 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:33 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f" returned: 0 in 0.557s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:33 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f Apr 15 10:10:33 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:33 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.info" returned: 0 in 0.439s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.126s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.955s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1977508577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a245f7-26b6-4148-bf12-7eb7474e0ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed7226bb27e44098c5b850907c49618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:31Z,use_quota=True,user_id='3ee9fa1644e44f04abc82f88231abbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Creating volume 12a245f7-26b6-4148-bf12-7eb7474e0ce2 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:33 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:33 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2 1073741824 Apr 15 10:10:33 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d87341f4-6b84-4366-a75d-5ef671ceffb3 tempest-GroupSnapshotsTest-1684095675 None] group_snapshot d7f48730-f6a8-4884-b8fb-488b6e27a558: created successfully Apr 15 10:10:33 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.442s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Deleted volume successfully. Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-11574778-1427-4c72-bb15-9b6bd9efb16c tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-ca5baa41-129a-4857-a157-92fbcecd7741-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:33 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1.7fc09403-45fe-4df6-a5ca-1549cf9cec4f" returned: 0 in 0.564s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "cinder-quobyte-7fc09403-45fe-4df6-a5ca-1549cf9cec4f" released by "_delete_snapshot" :: held 2.287s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "cinder-quobyte-8c017dc9-10c1-462e-8a2e-2881daac1ef1" released by "delete_snapshot" :: held 2.308s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:33 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2 1073741824" returned: 0 in 0.581s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Created reservations ['bb747eaa-fafd-4a0b-8ded-15324178a271', '37ca9d35-e733-42af-a7dc-5c1bd85c930b', 'b6f6e809-983a-40b4-b6a9-3a17b543aaf4', '1c054508-88ea-48e3-8c41-668308f8f8e5'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:33 devstack sudo[87854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2 Apr 15 10:10:33 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Delete snapshot completed successfully. Apr 15 10:10:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-616f7c37-bb1a-40aa-b239-ff4b942929c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "cinder-7fc09403-45fe-4df6-a5ca-1549cf9cec4f-delete_snapshot" released by "delete_snapshot" :: held 2.460s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-80ee6e58-f54d-439d-89e2-0cb8c7ebec81-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-80ee6e58-f54d-439d-89e2-0cb8c7ebec81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-quobyte-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-quobyte-80ee6e58-f54d-439d-89e2-0cb8c7ebec81" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-80ee6e58-f54d-439d-89e2-0cb8c7ebec81" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Deleting offline snapshot 80ee6e58-f54d-439d-89e2-0cb8c7ebec81 of volume 0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] snapshot_file for this snap is: volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b00b9f-00fd-49d0-a82b-61d46dc4f317]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:34 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 Apr 15 10:10:34 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:34 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2" returned: 0 in 0.445s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c53d0c6-285c-41ac-8810-83d2ee9e7094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1be16b-4ca2-4169-9e67-2c42bd7f7243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:34 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Volume volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2 (12a245f7-26b6-4148-bf12-7eb7474e0ce2): created successfully Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1be16b-4ca2-4169-9e67-2c42bd7f7243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Flow 'volume_create_manager' (14eba128-5b3c-47b4-b375-079a7ccf4630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-03cfdaf6-5a6f-47ea-9832-9f415c23fff6 tempest-VolumesTransfersV357Test-1806084937 None] Created volume successfully. Apr 15 10:10:34 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81" returned: 0 in 0.459s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b901afd3-e95d-4900-b55d-f08d48147680]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:34 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 Apr 15 10:10:34 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Acquiring lock "cinder-8c017dc9-10c1-462e-8a2e-2881daac1ef1-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "cinder-8c017dc9-10c1-462e-8a2e-2881daac1ef1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-b85ae923-3625-47ec-8786-fd846d5b86e2-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-b85ae923-3625-47ec-8786-fd846d5b86e2-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Creating volume bc048f5b-1bb2-493f-bdd3-0e8857a6ed04 from snapshot b85ae923-3625-47ec-8786-fd846d5b86e2 {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Acquiring lock "cinder-quobyte-8c017dc9-10c1-462e-8a2e-2881daac1ef1" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] snapshot: b85ae923-3625-47ec-8786-fd846d5b86e2, volume: bc048f5b-1bb2-493f-bdd3-0e8857a6ed04, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "cinder-quobyte-8c017dc9-10c1-462e-8a2e-2881daac1ef1" acquired by "delete_volume" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e588c25f-4078-47ec-b9af-32bd9410ccef]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5f93bc-be86-48ba-a8b2-94fd91e87cd2]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:34 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 Apr 15 10:10:34 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:34 devstack sudo[87897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 Apr 15 10:10:34 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:35 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2" returned: 0 in 0.602s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:35 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 Apr 15 10:10:35 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:35 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1" returned: 0 in 0.468s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:35 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1 Apr 15 10:10:35 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:35 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2" returned: 0 in 0.575s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dcb6789-ba96-4231-9943-2c782baf8643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] will copy from snapshot at /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aacaaa7-a862-45c8-9bba-f5685adc47ed]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:35 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 Apr 15 10:10:35 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Acquiring lock "cinder-12a245f7-26b6-4148-bf12-7eb7474e0ce2-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Lock "cinder-12a245f7-26b6-4148-bf12-7eb7474e0ce2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Acquiring lock "cinder-quobyte-12a245f7-26b6-4148-bf12-7eb7474e0ce2" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Lock "cinder-quobyte-12a245f7-26b6-4148-bf12-7eb7474e0ce2" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[662d0fac-f9a6-4fa6-89f3-bdd30a5e645d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:35 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81" returned: 0 in 0.613s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:35 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81 Apr 15 10:10:35 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:35 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2 Apr 15 10:10:35 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:35 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8c017dc9-10c1-462e-8a2e-2881daac1ef1" returned: 0 in 0.486s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "cinder-quobyte-8c017dc9-10c1-462e-8a2e-2881daac1ef1" released by "delete_volume" :: held 1.027s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Created reservations ['e69a212d-a396-43a8-8d02-f159948fe75e', '35472af5-8298-44a9-b348-c4c0a67864c5', '5213cb3a-6f69-42b5-acbb-1b70ec722ece', '011d2fe6-6a8a-44b0-a3b0-7fac113ce432'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:35 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:35 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:36 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643" returned: 0 in 0.598s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:36 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Path /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:10:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:36 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04 Apr 15 10:10:36 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:36 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2.80ee6e58-f54d-439d-89e2-0cb8c7ebec81" returned: 0 in 0.527s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-80ee6e58-f54d-439d-89e2-0cb8c7ebec81" released by "_delete_snapshot" :: held 2.264s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2" released by "delete_snapshot" :: held 2.278s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:36 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2" returned: 0 in 0.596s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:36 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2 Apr 15 10:10:36 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:36 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Created reservations ['2aceea58-dc22-4d77-acc0-45638aaf6d92', '3e28fdf5-5897-4992-b627-921cf06c2611', '1da16fae-2045-4cdf-b411-15b4059c6e63', '5ba3c1b1-926e-4ab3-8782-a634b62ae565'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:36 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Delete snapshot completed successfully. Apr 15 10:10:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81956b44-5e03-4898-86d2-230c184152b4 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-80ee6e58-f54d-439d-89e2-0cb8c7ebec81-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:36 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.554s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:36 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:36 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Deleted volume successfully. Apr 15 10:10:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-51cb80a4-12a9-477c-a9aa-edc8e594285c tempest-VolumeSnapshotQuotasNegativeTestJSON-254625539 None] Lock "cinder-8c017dc9-10c1-462e-8a2e-2881daac1ef1-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:37 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "cinder-quobyte-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-12a245f7-26b6-4148-bf12-7eb7474e0ce2" returned: 0 in 1.226s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Lock "cinder-quobyte-12a245f7-26b6-4148-bf12-7eb7474e0ce2" released by "delete_volume" :: held 1.874s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2" acquired by "delete_volume" :: waited 0.112s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fa3c4a-e254-4077-9dd3-f6f4e97e1683]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Created reservations ['1847e205-de8d-438c-a59f-dc33c4e5bf90', '16cb8e44-9801-44a1-918f-3cf4b41afcc1', '08718fda-6fac-4b5b-984b-4d42a844eadb', '0f86fe1f-36e5-4bce-98f1-a46d9519bb36'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:37 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:37 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:38 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:38 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 Apr 15 10:10:38 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:38 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:38 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04" returned: 0 in 2.278s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:38 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4a0b10-b113-4426-913a-d283605c56de]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:38 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 Apr 15 10:10:38 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:38 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.030s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:38 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:39 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2" returned: 0 in 1.386s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:39 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.068s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:39 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:39 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Deleted volume successfully. Apr 15 10:10:39 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2 Apr 15 10:10:39 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643" returned: 0 in 0.814s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643, size 1024.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:10:39 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Converted 1024.00 MB image at 449.27 MB/s Apr 15 10:10:39 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2053d4b7-dd01-425d-8ad1-e52a19789892 tempest-VolumesTransfersV357Test-1787183396 None] Lock "cinder-12a245f7-26b6-4148-bf12-7eb7474e0ce2-delete_volume" released by "delete_volume" :: held 3.519s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:39 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04 Apr 15 10:10:39 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:39 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2" returned: 0 in 0.567s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-quobyte-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2" released by "delete_volume" :: held 2.039s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Created reservations ['191394ca-3afc-4d02-814a-a3a65d63b565', '9196900a-7749-40fd-af3d-43b38b73b9d8', '48d8994d-9915-49e0-b5b2-d70a64b955aa', '04c57191-d405-4b86-ab4a-2d8c1f4ee9b4'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:39 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04" returned: 0 in 0.611s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04" released by "_copy_volume_from_snapshot" :: held 4.993s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-b85ae923-3625-47ec-8786-fd846d5b86e2-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04" released by "_create_volume_from_snapshot" :: held 5.039s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.062s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:39 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:39 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:39 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a67d6c0c-b670-4fa7-a9da-89f39a4d1a58 tempest-GroupSnapshotsTest-1684095675 None] Create group from source-snapshot-d7f48730-f6a8-4884-b8fb-488b6e27a558 completed successfully. Apr 15 10:10:40 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.591s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:40 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:40 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Deleted volume successfully. Apr 15 10:10:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ad5d4503-8091-4b4c-89de-5062fa3a5305 tempest-CreateVolumesFromSnapshotTest-1065813763 None] Lock "cinder-0a9f4226-a8b3-4d46-8ddf-fb59b17e31b2-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04" acquired by "delete_volume" :: waited 0.029s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:40 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f23a1e-c4ea-4ac8-bb29-e6a7e0eb8362]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:41 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04 Apr 15 10:10:41 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:41 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04" returned: 0 in 0.643s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:41 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04 Apr 15 10:10:41 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:42 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04" returned: 0 in 0.471s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-bc048f5b-1bb2-493f-bdd3-0e8857a6ed04" released by "delete_volume" :: held 1.165s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Created reservations ['365821e1-e015-4041-b1af-853a932b5caa'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:42 devstack cinder-volume[83167]: WARNING cinder.quota [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1489623954 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1489623954, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:42 devstack cinder-volume[83167]: WARNING cinder.quota [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1489623954 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1489623954, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Created reservations ['0f55e89d-f000-4bc3-a61e-2941a6098ad1', 'a7137748-3eda-4c8b-bd71-31f7a42d780f', 'd9b9bf8d-8cb0-434f-9a66-86a4008399cd', '7ca1622f-052a-4f87-a910-21480beb01f0'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:42 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:42 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Flow 'volume_create_manager' (3609e31c-c9d0-45c5-8737-6ec4384da8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067dbbef-3b5e-4746-9087-24af80fbf00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067dbbef-3b5e-4746-9087-24af80fbf00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1766505298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f5e18e5-eae2-48f9-9fe6-d55a591d2680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ba0babc8440b5914e97b2d9f62314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:43Z,use_quota=True,user_id='505e659d3bc74536a18f2345a0d2b9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b710018-48d6-457c-a511-56014144786f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b710018-48d6-457c-a511-56014144786f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0548b3-76a6-4eae-86f9-976ed0990ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0548b3-76a6-4eae-86f9-976ed0990ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f5e18e5-eae2-48f9-9fe6-d55a591d2680', 'volume_name': 'volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c031c546-6d30-4094-842f-34419bed8f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c031c546-6d30-4094-842f-34419bed8f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb772dc5-2cf1-404c-a06f-571efc341591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:42 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume 7f5e18e5-eae2-48f9-9fe6-d55a591d2680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680', 'volume_size': 1} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1766505298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f5e18e5-eae2-48f9-9fe6-d55a591d2680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ba0babc8440b5914e97b2d9f62314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:43Z,use_quota=True,user_id='505e659d3bc74536a18f2345a0d2b9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Creating volume 7f5e18e5-eae2-48f9-9fe6-d55a591d2680 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:42 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:42 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:42 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:42 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6c4f284d-e29d-4798-80fc-bbc4b68c93c6 tempest-GroupSnapshotsTest-1684095675 None] Delete group completed successfully. Apr 15 10:10:42 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680 1073741824 Apr 15 10:10:42 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Flow 'volume_create_manager' (895814e8-4717-4292-b867-09980adcc305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5113191e-6e2d-4e4c-ad8a-b7fcaa26f6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5113191e-6e2d-4e4c-ad8a-b7fcaa26f6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-503948034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452ee804-6ed9-4c92-810a-822fa4485663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0496acbaa5a4d33b75e3442fab0cc6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:43Z,use_quota=True,user_id='51344e45e7bb4a32885c8a2391a91b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fc6e56c-3f23-41db-a724-d8a9a8f97308),volume_type_id=0fc6e56c-3f23-41db-a724-d8a9a8f97308)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f5b299-4452-492a-baaa-f49342872ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f5b299-4452-492a-baaa-f49342872ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d88d4f6-2fd9-4e1f-b236-27b194d2d236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d88d4f6-2fd9-4e1f-b236-27b194d2d236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '452ee804-6ed9-4c92-810a-822fa4485663', 'volume_name': 'volume-452ee804-6ed9-4c92-810a-822fa4485663', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35baf16-9acc-4303-a0c9-733fafdc4849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35baf16-9acc-4303-a0c9-733fafdc4849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dac3984-ffd5-4b91-a3cc-8f7ab37b875b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:43 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Volume 452ee804-6ed9-4c92-810a-822fa4485663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-452ee804-6ed9-4c92-810a-822fa4485663', 'volume_size': 1} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:43 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] group_snapshot d7f48730-f6a8-4884-b8fb-488b6e27a558: deleting Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] group_snapshot d7f48730-f6a8-4884-b8fb-488b6e27a558: deleting {{(pid=83167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-9dcb6789-ba96-4231-9943-2c782baf8643" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-9dcb6789-ba96-4231-9943-2c782baf8643" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-b85ae923-3625-47ec-8786-fd846d5b86e2" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-b85ae923-3625-47ec-8786-fd846d5b86e2" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Deleting offline snapshot b85ae923-3625-47ec-8786-fd846d5b86e2 of volume 9dcb6789-ba96-4231-9943-2c782baf8643 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] snapshot_file for this snap is: volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5294df-d74e-4276-a237-be9327092184]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:43 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 Apr 15 10:10:43 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:43 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680 1073741824" returned: 0 in 0.755s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:43 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680 Apr 15 10:10:43 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:43 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2" returned: 0 in 0.620s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dcb6789-ba96-4231-9943-2c782baf8643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0f4b13-c7ab-42f3-a8f5-8575d64a417f]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:43 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 Apr 15 10:10:43 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:43 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680" returned: 0 in 0.479s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-503948034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452ee804-6ed9-4c92-810a-822fa4485663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0496acbaa5a4d33b75e3442fab0cc6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:43Z,use_quota=True,user_id='51344e45e7bb4a32885c8a2391a91b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fc6e56c-3f23-41db-a724-d8a9a8f97308),volume_type_id=0fc6e56c-3f23-41db-a724-d8a9a8f97308)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Creating volume 452ee804-6ed9-4c92-810a-822fa4485663 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:44 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-452ee804-6ed9-4c92-810a-822fa4485663 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb772dc5-2cf1-404c-a06f-571efc341591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:44 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-452ee804-6ed9-4c92-810a-822fa4485663 1073741824 Apr 15 10:10:44 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8f83f8-ceb7-4127-9596-df9055868620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:44 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680 (7f5e18e5-eae2-48f9-9fe6-d55a591d2680): created successfully Apr 15 10:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8f83f8-ceb7-4127-9596-df9055868620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Flow 'volume_create_manager' (3609e31c-c9d0-45c5-8737-6ec4384da8ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-61a18c5f-e3af-4e78-abb0-533a622562db tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Created volume successfully. Apr 15 10:10:44 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:44 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 Apr 15 10:10:44 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:44 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-452ee804-6ed9-4c92-810a-822fa4485663 1073741824" returned: 0 in 0.684s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-452ee804-6ed9-4c92-810a-822fa4485663 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:44 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-452ee804-6ed9-4c92-810a-822fa4485663 Apr 15 10:10:44 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:45 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2" returned: 0 in 0.571s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:45 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2 Apr 15 10:10:45 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Flow 'volume_create_manager' (9ff9e24f-7ec9-4dd5-92d7-dfe2dc529ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dbaed9-9c23-434e-bec5-8134f39cbbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dbaed9-9c23-434e-bec5-8134f39cbbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-564119865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dc85ca-54ad-414c-838c-c7072abd7239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ba0babc8440b5914e97b2d9f62314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:45Z,use_quota=True,user_id='505e659d3bc74536a18f2345a0d2b9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c6ca3f-fcd4-48a4-9bf6-98813e45c763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c6ca3f-fcd4-48a4-9bf6-98813e45c763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886a42f3-919d-44f5-ae25-f88f5f111419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886a42f3-919d-44f5-ae25-f88f5f111419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0dc85ca-54ad-414c-838c-c7072abd7239', 'volume_name': 'volume-e0dc85ca-54ad-414c-838c-c7072abd7239', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c37fca3-32dd-46ae-b6d4-6a8b3547e47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c37fca3-32dd-46ae-b6d4-6a8b3547e47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5529a0e-9619-432a-9268-d35ba7bd30e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume e0dc85ca-54ad-414c-838c-c7072abd7239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0dc85ca-54ad-414c-838c-c7072abd7239', 'volume_size': 1} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:45 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-452ee804-6ed9-4c92-810a-822fa4485663" returned: 0 in 0.569s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.132s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-564119865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dc85ca-54ad-414c-838c-c7072abd7239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ba0babc8440b5914e97b2d9f62314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:45Z,use_quota=True,user_id='505e659d3bc74536a18f2345a0d2b9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Creating volume e0dc85ca-54ad-414c-838c-c7072abd7239 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:45 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0dc85ca-54ad-414c-838c-c7072abd7239 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dac3984-ffd5-4b91-a3cc-8f7ab37b875b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-452ee804-6ed9-4c92-810a-822fa4485663', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0c434a-8334-4b9e-a860-e2e54e1ddd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0dc85ca-54ad-414c-838c-c7072abd7239 1073741824 Apr 15 10:10:45 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:45 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Volume volume-452ee804-6ed9-4c92-810a-822fa4485663 (452ee804-6ed9-4c92-810a-822fa4485663): created successfully Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0c434a-8334-4b9e-a860-e2e54e1ddd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Flow 'volume_create_manager' (895814e8-4717-4292-b867-09980adcc305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:45 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-800f1163-b337-43aa-8fdd-92675b7191ab tempest-VolumeTypesAccessTest-1092024773 None] Created volume successfully. Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Flow 'volume_create_manager' (83f15f52-1101-4359-a0e1-ad136a8f4404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9bd7bd-19d9-470c-bc4e-903c409b7338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9bd7bd-19d9-470c-bc4e-903c409b7338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1182579661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e28de240-995b-4a3d-a7d7-6000e2947378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ba0babc8440b5914e97b2d9f62314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:45Z,use_quota=True,user_id='505e659d3bc74536a18f2345a0d2b9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c65bce-63e8-40f5-a09c-68955593db3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c65bce-63e8-40f5-a09c-68955593db3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dccde0f-2a07-446c-bbfb-e0aceb75667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dccde0f-2a07-446c-bbfb-e0aceb75667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e28de240-995b-4a3d-a7d7-6000e2947378', 'volume_name': 'volume-e28de240-995b-4a3d-a7d7-6000e2947378', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4fe04d-cbc3-4d0d-a780-1fb0ee44b16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4fe04d-cbc3-4d0d-a780-1fb0ee44b16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cadbafa-b2d7-44bb-8f63-c5c9fa8b0b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume e28de240-995b-4a3d-a7d7-6000e2947378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e28de240-995b-4a3d-a7d7-6000e2947378', 'volume_size': 1} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Flow 'volume_create_manager' (d5a8a47f-7244-48fc-abe8-35129a53e14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b674e3b9-2e84-4232-a56a-0dd76f915641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b674e3b9-2e84-4232-a56a-0dd76f915641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565587130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b62f7ef-9fcc-4471-a1ce-983498c26869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ba0babc8440b5914e97b2d9f62314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:46Z,use_quota=True,user_id='505e659d3bc74536a18f2345a0d2b9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490922c7-b2b0-4a64-b1a6-92ee58b92856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490922c7-b2b0-4a64-b1a6-92ee58b92856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eedb2d5-8859-46f8-bacd-22de8cac1900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eedb2d5-8859-46f8-bacd-22de8cac1900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b62f7ef-9fcc-4471-a1ce-983498c26869', 'volume_name': 'volume-7b62f7ef-9fcc-4471-a1ce-983498c26869', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0d5938-9dab-41e5-8226-9980e6734949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0d5938-9dab-41e5-8226-9980e6734949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:45 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f9b889-bc7c-4400-9337-279382c1c9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:45 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume 7b62f7ef-9fcc-4471-a1ce-983498c26869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b62f7ef-9fcc-4471-a1ce-983498c26869', 'volume_size': 1} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643.b85ae923-3625-47ec-8786-fd846d5b86e2" returned: 0 in 0.802s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-b85ae923-3625-47ec-8786-fd846d5b86e2" released by "_delete_snapshot" :: held 2.626s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-9dcb6789-ba96-4231-9943-2c782baf8643" released by "delete_snapshot" :: held 2.641s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:45 devstack cinder-volume[83167]: WARNING cinder.quota [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1489623954 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1489623954, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:45 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] Created reservations ['e9a68f6c-5b53-4c37-8151-c1fd3343f84b', '9849e06e-4991-46b9-bf0d-65d9c51ada07', '11f59ec8-18ae-464e-82ab-cc3c7934aa56', 'ea74607f-9429-4791-a1d5-ab2c378c1227'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:45 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7783ad24-e844-45c5-9d8a-5925dc2d52c2 tempest-GroupSnapshotsTest-1684095675 None] group_snapshot d7f48730-f6a8-4884-b8fb-488b6e27a558: deleted successfully Apr 15 10:10:46 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0dc85ca-54ad-414c-838c-c7072abd7239 1073741824" returned: 0 in 0.687s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Flow 'volume_create_manager' (4a4153ba-c2a9-4728-bf77-9c81fb7dd43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33453526-91c9-49f6-9720-07a181bcb3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33453526-91c9-49f6-9720-07a181bcb3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733739456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d532015-d393-4067-9a45-ee2ce680d022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ba0babc8440b5914e97b2d9f62314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:46Z,use_quota=True,user_id='505e659d3bc74536a18f2345a0d2b9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3434a49-4462-4628-94c4-d40f4eefcaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3434a49-4462-4628-94c4-d40f4eefcaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2a5bb7-e963-48e8-abaa-fc671fe6efdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2a5bb7-e963-48e8-abaa-fc671fe6efdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d532015-d393-4067-9a45-ee2ce680d022', 'volume_name': 'volume-5d532015-d393-4067-9a45-ee2ce680d022', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400c8024-1dfe-4789-97a9-85c203adcf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400c8024-1dfe-4789-97a9-85c203adcf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21037139-160b-497b-9bbd-edf981afadb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume 5d532015-d393-4067-9a45-ee2ce680d022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d532015-d393-4067-9a45-ee2ce680d022', 'volume_size': 1} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0dc85ca-54ad-414c-838c-c7072abd7239 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:46 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0dc85ca-54ad-414c-838c-c7072abd7239 Apr 15 10:10:46 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Flow 'volume_create_manager' (272aa7a2-8dae-43af-b5ef-593b2a2f62c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8919ece1-c32a-4195-a3b2-0410d48f70b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8919ece1-c32a-4195-a3b2-0410d48f70b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403141219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666e95a0-55c9-4b47-a40d-d7382b286e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ba0babc8440b5914e97b2d9f62314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:46Z,use_quota=True,user_id='505e659d3bc74536a18f2345a0d2b9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e29ec24-f38d-46b4-9985-05677b06c0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e29ec24-f38d-46b4-9985-05677b06c0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49bd0f2-a763-4897-ae9d-a9791ce87fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49bd0f2-a763-4897-ae9d-a9791ce87fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '666e95a0-55c9-4b47-a40d-d7382b286e1b', 'volume_name': 'volume-666e95a0-55c9-4b47-a40d-d7382b286e1b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73ec61e-ad7e-4d82-9f1a-884fe3908db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73ec61e-ad7e-4d82-9f1a-884fe3908db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629e270c-7627-415e-bd75-7c3f6e3f5a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume 666e95a0-55c9-4b47-a40d-d7382b286e1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-666e95a0-55c9-4b47-a40d-d7382b286e1b', 'volume_size': 1} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Acquiring lock "cinder-452ee804-6ed9-4c92-810a-822fa4485663-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Lock "cinder-452ee804-6ed9-4c92-810a-822fa4485663-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Acquiring lock "cinder-quobyte-452ee804-6ed9-4c92-810a-822fa4485663" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Lock "cinder-quobyte-452ee804-6ed9-4c92-810a-822fa4485663" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b87768-43c4-4531-afff-f002a3d9c58b]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-452ee804-6ed9-4c92-810a-822fa4485663 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:46 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-452ee804-6ed9-4c92-810a-822fa4485663 Apr 15 10:10:46 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-9dcb6789-ba96-4231-9943-2c782baf8643" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-9dcb6789-ba96-4231-9943-2c782baf8643" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64afc8b-b2e4-4761-88d8-4924e65f2ac1]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:46 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 Apr 15 10:10:46 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:46 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0dc85ca-54ad-414c-838c-c7072abd7239" returned: 0 in 0.660s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.282s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1182579661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e28de240-995b-4a3d-a7d7-6000e2947378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ba0babc8440b5914e97b2d9f62314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:45Z,use_quota=True,user_id='505e659d3bc74536a18f2345a0d2b9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Creating volume e28de240-995b-4a3d-a7d7-6000e2947378 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:46 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e28de240-995b-4a3d-a7d7-6000e2947378 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5529a0e-9619-432a-9268-d35ba7bd30e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0dc85ca-54ad-414c-838c-c7072abd7239', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e145a90b-d705-434e-aef6-a2899a389220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e28de240-995b-4a3d-a7d7-6000e2947378 1073741824 Apr 15 10:10:46 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:46 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume volume-e0dc85ca-54ad-414c-838c-c7072abd7239 (e0dc85ca-54ad-414c-838c-c7072abd7239): created successfully Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e145a90b-d705-434e-aef6-a2899a389220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Flow 'volume_create_manager' (9ff9e24f-7ec9-4dd5-92d7-dfe2dc529ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-40c350c7-671c-47c8-a867-f03e63c8fd11 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Created volume successfully. Apr 15 10:10:47 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-452ee804-6ed9-4c92-810a-822fa4485663" returned: 0 in 0.649s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-452ee804-6ed9-4c92-810a-822fa4485663 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:47 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-452ee804-6ed9-4c92-810a-822fa4485663 Apr 15 10:10:47 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:47 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643" returned: 0 in 0.524s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:47 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643 Apr 15 10:10:47 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:47 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e28de240-995b-4a3d-a7d7-6000e2947378 1073741824" returned: 0 in 0.630s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e28de240-995b-4a3d-a7d7-6000e2947378 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:47 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e28de240-995b-4a3d-a7d7-6000e2947378 Apr 15 10:10:47 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:47 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-452ee804-6ed9-4c92-810a-822fa4485663" returned: 0 in 0.509s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Lock "cinder-quobyte-452ee804-6ed9-4c92-810a-822fa4485663" released by "delete_volume" :: held 1.206s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:47 devstack cinder-volume[83167]: WARNING cinder.quota [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-345493189 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-345493189, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:47 devstack cinder-volume[83167]: WARNING cinder.quota [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-345493189 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-345493189, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Created reservations ['991b6814-8c70-489a-b9c9-ff1f3a1e9934', 'dca3335b-bf5c-4e3f-8b3c-57dba665318c', 'a27eee22-d4ec-4533-b1a8-a7fc98ba1bc2', '0d71d8f9-9629-4d44-a394-bc62ebf85fc2'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:47 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9dcb6789-ba96-4231-9943-2c782baf8643" returned: 0 in 0.546s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-9dcb6789-ba96-4231-9943-2c782baf8643" released by "delete_volume" :: held 1.113s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Created reservations ['d1c397d5-d6b1-4edb-8156-2388670a2632'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:47 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:47 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:47 devstack cinder-volume[83167]: WARNING cinder.db.sqlalchemy.api [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1489623954'] Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Created reservations ['9893e637-4b75-466d-8755-a4a823fe5934', '51ae9c2a-e642-4915-a4c5-bdf9648c8653', '98c8e9b3-eee6-429c-8aba-b17dafbd274f', 'feb4b5f5-43a8-49c1-b73e-b5f61a6077bb'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:47 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:47 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:48 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e28de240-995b-4a3d-a7d7-6000e2947378" returned: 0 in 0.743s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.386s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565587130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b62f7ef-9fcc-4471-a1ce-983498c26869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ba0babc8440b5914e97b2d9f62314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:46Z,use_quota=True,user_id='505e659d3bc74536a18f2345a0d2b9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Creating volume 7b62f7ef-9fcc-4471-a1ce-983498c26869 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:48 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b62f7ef-9fcc-4471-a1ce-983498c26869 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cadbafa-b2d7-44bb-8f63-c5c9fa8b0b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e28de240-995b-4a3d-a7d7-6000e2947378', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993aebaa-bc2b-40ca-a22b-850f1ad53d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:48 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume volume-e28de240-995b-4a3d-a7d7-6000e2947378 (e28de240-995b-4a3d-a7d7-6000e2947378): created successfully Apr 15 10:10:48 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b62f7ef-9fcc-4471-a1ce-983498c26869 1073741824 Apr 15 10:10:48 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993aebaa-bc2b-40ca-a22b-850f1ad53d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Flow 'volume_create_manager' (83f15f52-1101-4359-a0e1-ad136a8f4404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5deac2af-62ad-43a8-8215-a623cd7ff5ea tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Created volume successfully. Apr 15 10:10:48 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.583s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Deleted volume successfully. Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9068a450-dc5c-45d1-894a-4d11bacc6bb1 tempest-VolumeTypesAccessTest-1092024773 None] Lock "cinder-452ee804-6ed9-4c92-810a-822fa4485663-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:48 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.584s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2ea92629-2fce-4c6e-9d08-59e65f557ef6 tempest-GroupSnapshotsTest-1684095675 None] Delete group completed successfully. Apr 15 10:10:48 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b62f7ef-9fcc-4471-a1ce-983498c26869 1073741824" returned: 0 in 0.733s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b62f7ef-9fcc-4471-a1ce-983498c26869 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:48 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b62f7ef-9fcc-4471-a1ce-983498c26869 Apr 15 10:10:48 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:49 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-18fe35da-b177-4bcf-a89d-25545bc764d7 tempest-GroupSnapshotsTest-1684095675 None] Group tempest-GroupSnapshotsTest-Group-590428772: creating Apr 15 10:10:49 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-18fe35da-b177-4bcf-a89d-25545bc764d7 tempest-GroupSnapshotsTest-1684095675 None] Group tempest-GroupSnapshotsTest-Group-590428772: created successfully Apr 15 10:10:49 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-18fe35da-b177-4bcf-a89d-25545bc764d7 tempest-GroupSnapshotsTest-1684095675 None] Create group completed successfully. Apr 15 10:10:49 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b62f7ef-9fcc-4471-a1ce-983498c26869" returned: 0 in 0.530s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.415s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733739456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d532015-d393-4067-9a45-ee2ce680d022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ba0babc8440b5914e97b2d9f62314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:46Z,use_quota=True,user_id='505e659d3bc74536a18f2345a0d2b9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Creating volume 5d532015-d393-4067-9a45-ee2ce680d022 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:49 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5d532015-d393-4067-9a45-ee2ce680d022 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f9b889-bc7c-4400-9337-279382c1c9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b62f7ef-9fcc-4471-a1ce-983498c26869', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:49 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5d532015-d393-4067-9a45-ee2ce680d022 1073741824 Apr 15 10:10:49 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a7fb58-3e1a-4f45-8734-de1c2910b1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:49 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume volume-7b62f7ef-9fcc-4471-a1ce-983498c26869 (7b62f7ef-9fcc-4471-a1ce-983498c26869): created successfully Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a7fb58-3e1a-4f45-8734-de1c2910b1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Flow 'volume_create_manager' (d5a8a47f-7244-48fc-abe8-35129a53e14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:49 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-563283cf-1746-4227-89ff-0e461ca8f6af tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Created volume successfully. Apr 15 10:10:50 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5d532015-d393-4067-9a45-ee2ce680d022 1073741824" returned: 0 in 0.625s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5d532015-d393-4067-9a45-ee2ce680d022 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:50 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5d532015-d393-4067-9a45-ee2ce680d022 Apr 15 10:10:50 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Flow 'volume_create_manager' (64ddcae2-5021-43b6-92c3-603b1b8c5671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f499c1cf-90f2-4449-9215-7ababedad9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f499c1cf-90f2-4449-9215-7ababedad9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-741895233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d108ed8d-dabe-4703-b3c5-61bf3e86b8df,host='devstack@QuobyteHD#QuobyteHD',id=31d0f84c-13ef-4e68-bcc7-ba81f6128bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5933ebf5bb8472fa36563cd0009d3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:51Z,use_quota=True,user_id='120e1cfec1a44d7291b7602661878181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cc51257-8764-446a-8beb-6d27c8f03530),volume_type_id=8cc51257-8764-446a-8beb-6d27c8f03530)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c216b44-9283-4d1c-bac7-de7328a5f81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c216b44-9283-4d1c-bac7-de7328a5f81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bb0fe5-5eab-4dcf-b4e7-7b254dd6ceef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bb0fe5-5eab-4dcf-b4e7-7b254dd6ceef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d0f84c-13ef-4e68-bcc7-ba81f6128bb5', 'volume_name': 'volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fac6e17-f9d4-4f17-9c95-4652a972e14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fac6e17-f9d4-4f17-9c95-4652a972e14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcafebb-ed7b-459d-b23f-d9363c2cb961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:50 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Volume 31d0f84c-13ef-4e68-bcc7-ba81f6128bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5', 'volume_size': 1} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:50 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5d532015-d393-4067-9a45-ee2ce680d022" returned: 0 in 0.663s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.494s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403141219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666e95a0-55c9-4b47-a40d-d7382b286e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ba0babc8440b5914e97b2d9f62314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:46Z,use_quota=True,user_id='505e659d3bc74536a18f2345a0d2b9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Creating volume 666e95a0-55c9-4b47-a40d-d7382b286e1b {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:50 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-666e95a0-55c9-4b47-a40d-d7382b286e1b 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21037139-160b-497b-9bbd-edf981afadb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d532015-d393-4067-9a45-ee2ce680d022', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6b1d83-e916-4789-b14a-7cec7ffc88db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:50 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-666e95a0-55c9-4b47-a40d-d7382b286e1b 1073741824 Apr 15 10:10:50 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:50 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume volume-5d532015-d393-4067-9a45-ee2ce680d022 (5d532015-d393-4067-9a45-ee2ce680d022): created successfully Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6b1d83-e916-4789-b14a-7cec7ffc88db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Flow 'volume_create_manager' (4a4153ba-c2a9-4728-bf77-9c81fb7dd43b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:50 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-84a7964d-c293-405c-824c-30a5a159a863 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Created volume successfully. Apr 15 10:10:51 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-666e95a0-55c9-4b47-a40d-d7382b286e1b 1073741824" returned: 0 in 0.610s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-666e95a0-55c9-4b47-a40d-d7382b286e1b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:51 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-666e95a0-55c9-4b47-a40d-d7382b286e1b Apr 15 10:10:51 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:51 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-666e95a0-55c9-4b47-a40d-d7382b286e1b" returned: 0 in 0.539s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.314s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d108ed8d-dabe-4703-b3c5-61bf3e86b8df,created_at=2026-04-15T08:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-741895233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d108ed8d-dabe-4703-b3c5-61bf3e86b8df,host='devstack@QuobyteHD#QuobyteHD',id=31d0f84c-13ef-4e68-bcc7-ba81f6128bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5933ebf5bb8472fa36563cd0009d3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:51Z,use_quota=True,user_id='120e1cfec1a44d7291b7602661878181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cc51257-8764-446a-8beb-6d27c8f03530),volume_type_id=8cc51257-8764-446a-8beb-6d27c8f03530)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Creating volume 31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:52 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629e270c-7627-415e-bd75-7c3f6e3f5a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-666e95a0-55c9-4b47-a40d-d7382b286e1b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9f2b05-6efc-40ec-9cfc-f19bd969d0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:52 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Volume volume-666e95a0-55c9-4b47-a40d-d7382b286e1b (666e95a0-55c9-4b47-a40d-d7382b286e1b): created successfully Apr 15 10:10:52 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 1073741824 Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9f2b05-6efc-40ec-9cfc-f19bd969d0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:52 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Flow 'volume_create_manager' (272aa7a2-8dae-43af-b5ef-593b2a2f62c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:52 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-01c26366-b93f-4dd6-834a-8988135cbc03 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Created volume successfully. Apr 15 10:10:52 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 1073741824" returned: 0 in 0.695s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:52 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 Apr 15 10:10:52 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "cinder-666e95a0-55c9-4b47-a40d-d7382b286e1b-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-666e95a0-55c9-4b47-a40d-d7382b286e1b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "cinder-quobyte-666e95a0-55c9-4b47-a40d-d7382b286e1b" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-quobyte-666e95a0-55c9-4b47-a40d-d7382b286e1b" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9c41d3-9942-4f53-b21a-a8f437020bbe]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-666e95a0-55c9-4b47-a40d-d7382b286e1b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Flow 'volume_create_manager' (f5818d12-79bc-4a6b-98a8-a9f1decdc71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:53 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-666e95a0-55c9-4b47-a40d-d7382b286e1b Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3ead3c-557d-4349-8fba-fd9ca1becd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:53 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3ead3c-557d-4349-8fba-fd9ca1becd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1983859438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655e5274-5f96-4d9d-8ff7-b79e82f2523d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ab25475caf4bcf894571a639345ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:53Z,use_quota=True,user_id='4f943014c56a422cbe0ad7b52c8b7b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf16aa7b-7ad4-4d72-8e07-36017d8b985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf16aa7b-7ad4-4d72-8e07-36017d8b985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73fac5e-66d3-4d11-856e-80c8872abfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73fac5e-66d3-4d11-856e-80c8872abfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '655e5274-5f96-4d9d-8ff7-b79e82f2523d', 'volume_name': 'volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2840cdc5-a733-4074-9048-7e164f5ba26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2840cdc5-a733-4074-9048-7e164f5ba26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c19241-871c-468f-8b77-d33713df1089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:53 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Volume 655e5274-5f96-4d9d-8ff7-b79e82f2523d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d', 'volume_size': 1} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:53 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5" returned: 0 in 0.524s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.097s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1983859438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655e5274-5f96-4d9d-8ff7-b79e82f2523d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ab25475caf4bcf894571a639345ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:53Z,use_quota=True,user_id='4f943014c56a422cbe0ad7b52c8b7b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Creating volume 655e5274-5f96-4d9d-8ff7-b79e82f2523d {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:53 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcafebb-ed7b-459d-b23f-d9363c2cb961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219b1adc-900f-47d0-a34d-279123f1ece2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:53 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d 1073741824 Apr 15 10:10:53 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:53 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Volume volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 (31d0f84c-13ef-4e68-bcc7-ba81f6128bb5): created successfully Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219b1adc-900f-47d0-a34d-279123f1ece2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Flow 'volume_create_manager' (64ddcae2-5021-43b6-92c3-603b1b8c5671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:53 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-eb04ec65-49bc-4245-b8d4-4860863e98c9 tempest-GroupSnapshotsTest-1684095675 None] Created volume successfully. Apr 15 10:10:53 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-666e95a0-55c9-4b47-a40d-d7382b286e1b" returned: 0 in 0.616s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-666e95a0-55c9-4b47-a40d-d7382b286e1b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:53 devstack sudo[88101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-666e95a0-55c9-4b47-a40d-d7382b286e1b Apr 15 10:10:53 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:53 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d 1073741824" returned: 0 in 0.635s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:53 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d Apr 15 10:10:53 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Flow 'volume_create_manager' (45ee1a4b-2fbe-4111-a243-ac46c0db6912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391d07f3-f3c6-4713-92cd-7b4861e3fcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391d07f3-f3c6-4713-92cd-7b4861e3fcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137262748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d108ed8d-dabe-4703-b3c5-61bf3e86b8df,host='devstack@QuobyteHD#QuobyteHD',id=b78dcf01-c31f-4002-89dc-e73df277b6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5933ebf5bb8472fa36563cd0009d3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:54Z,use_quota=True,user_id='120e1cfec1a44d7291b7602661878181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cc51257-8764-446a-8beb-6d27c8f03530),volume_type_id=8cc51257-8764-446a-8beb-6d27c8f03530)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d77a4e-1daf-4142-88ec-aa43e1ecb0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d77a4e-1daf-4142-88ec-aa43e1ecb0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e43ba40-c8c7-47d9-a068-c8d904f344ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e43ba40-c8c7-47d9-a068-c8d904f344ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b78dcf01-c31f-4002-89dc-e73df277b6dd', 'volume_name': 'volume-b78dcf01-c31f-4002-89dc-e73df277b6dd', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27466f8b-cedb-4c08-b439-79913e9f1c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27466f8b-cedb-4c08-b439-79913e9f1c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f460f698-4820-4530-9a2d-5c10176fa558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:54 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Volume b78dcf01-c31f-4002-89dc-e73df277b6dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b78dcf01-c31f-4002-89dc-e73df277b6dd', 'volume_size': 1} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-666e95a0-55c9-4b47-a40d-d7382b286e1b" returned: 0 in 0.572s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-quobyte-666e95a0-55c9-4b47-a40d-d7382b286e1b" released by "delete_volume" :: held 1.229s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Created reservations ['ddd99cb4-30ef-4e03-8292-25779a5d012d', '9b1ca36a-b4a6-4acb-9c7d-90ad8fe5aef0', '0dc00d6f-87ad-4952-a773-d3c23ad479ce', 'e01aa943-626f-4995-8222-760706b6cea9'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Flow 'volume_create_manager' (92de3692-3b28-4660-b58e-572b6f1bc02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ed8d5c-c775-46aa-afe5-f519c6b32c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ed8d5c-c775-46aa-afe5-f519c6b32c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-979428324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf79ce8d32148cf9c71c6caef3ad4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:54Z,use_quota=True,user_id='cb9c625ecd6045649628d0e19be1fc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b906113-a3b5-40c2-acdf-d8a8c9ad3b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b906113-a3b5-40c2-acdf-d8a8c9ad3b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64cbe67a-ae8c-49a7-ade2-d5cc867862cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64cbe67a-ae8c-49a7-ade2-d5cc867862cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0', 'volume_name': 'volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e429b466-517a-4893-9d23-0869ba9961b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e429b466-517a-4893-9d23-0869ba9961b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f043e05-c91b-440f-b7d9-2d46e73f5a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Volume ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0', 'volume_size': 1} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:54 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:54 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:54 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d" returned: 0 in 0.591s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.309s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d108ed8d-dabe-4703-b3c5-61bf3e86b8df,created_at=2026-04-15T08:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137262748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d108ed8d-dabe-4703-b3c5-61bf3e86b8df,host='devstack@QuobyteHD#QuobyteHD',id=b78dcf01-c31f-4002-89dc-e73df277b6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5933ebf5bb8472fa36563cd0009d3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:54Z,use_quota=True,user_id='120e1cfec1a44d7291b7602661878181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cc51257-8764-446a-8beb-6d27c8f03530),volume_type_id=8cc51257-8764-446a-8beb-6d27c8f03530)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Creating volume b78dcf01-c31f-4002-89dc-e73df277b6dd {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:54 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c19241-871c-468f-8b77-d33713df1089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd 1073741824 Apr 15 10:10:54 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ee59e0-cbf3-4472-be2a-a7867b43a89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Volume volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d (655e5274-5f96-4d9d-8ff7-b79e82f2523d): created successfully Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ee59e0-cbf3-4472-be2a-a7867b43a89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Flow 'volume_create_manager' (f5818d12-79bc-4a6b-98a8-a9f1decdc71d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:54 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-18c74875-0284-4627-ad39-04c833951795 tempest-VolumesActionsTest-753798396 None] Created volume successfully. Apr 15 10:10:54 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.485s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:54 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Deleted volume successfully. Apr 15 10:10:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef03f9f2-fd85-4445-a95f-81807af873a5 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-666e95a0-55c9-4b47-a40d-d7382b286e1b-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:55 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd 1073741824" returned: 0 in 0.513s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:55 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd Apr 15 10:10:55 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "cinder-5d532015-d393-4067-9a45-ee2ce680d022-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-5d532015-d393-4067-9a45-ee2ce680d022-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "cinder-quobyte-5d532015-d393-4067-9a45-ee2ce680d022" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-quobyte-5d532015-d393-4067-9a45-ee2ce680d022" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e1839c-e493-4973-bc29-4cf236d3998f]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5d532015-d393-4067-9a45-ee2ce680d022 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:55 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5d532015-d393-4067-9a45-ee2ce680d022 Apr 15 10:10:55 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:55 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd" returned: 0 in 0.525s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.230s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-979428324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf79ce8d32148cf9c71c6caef3ad4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:54Z,use_quota=True,user_id='cb9c625ecd6045649628d0e19be1fc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Creating volume ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:55 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f460f698-4820-4530-9a2d-5c10176fa558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b78dcf01-c31f-4002-89dc-e73df277b6dd', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1cccff-bef1-4a6d-8d51-e70e12417ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:55 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 1073741824 Apr 15 10:10:55 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:55 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Volume volume-b78dcf01-c31f-4002-89dc-e73df277b6dd (b78dcf01-c31f-4002-89dc-e73df277b6dd): created successfully Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1cccff-bef1-4a6d-8d51-e70e12417ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Flow 'volume_create_manager' (45ee1a4b-2fbe-4111-a243-ac46c0db6912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:55 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9459a4f3-56d4-41ee-84de-45e1f41b5d32 tempest-GroupSnapshotsTest-1684095675 None] Created volume successfully. Apr 15 10:10:55 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5d532015-d393-4067-9a45-ee2ce680d022" returned: 0 in 0.600s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5d532015-d393-4067-9a45-ee2ce680d022 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:55 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5d532015-d393-4067-9a45-ee2ce680d022 Apr 15 10:10:55 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:56 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 1073741824" returned: 0 in 0.729s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ef349372-727c-41f9-9230-ebd48ba717fe tempest-GroupSnapshotsTest-1684095675 None] Update group completed successfully. Apr 15 10:10:56 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 Apr 15 10:10:56 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:56 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5d532015-d393-4067-9a45-ee2ce680d022" returned: 0 in 0.619s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-quobyte-5d532015-d393-4067-9a45-ee2ce680d022" released by "delete_volume" :: held 1.246s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Created reservations ['a98db7c8-93d8-40e9-b758-179750377f8d', '42696342-8fae-4883-907b-689feb7efa53', 'e7259bbd-2189-4290-a73e-779756b435e3', '29f3f0d7-c8a0-497e-8213-b998cba49af4'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:56 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:56 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:56 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0" returned: 0 in 0.476s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f043e05-c91b-440f-b7d9-2d46e73f5a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a705e3-11f9-4d95-b6dd-d4bdfb41abb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:56 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Volume volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 (ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0): created successfully Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a705e3-11f9-4d95-b6dd-d4bdfb41abb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Flow 'volume_create_manager' (92de3692-3b28-4660-b58e-572b6f1bc02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-000c06c6-9a6a-4d92-9796-3a3c9f30cc55 tempest-SnapshotMetadataTestJSON-1714798066 None] Created volume successfully. Apr 15 10:10:56 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.454s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:56 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Deleted volume successfully. Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-80e803d5-97da-4fca-b81b-18cb1098387f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-5d532015-d393-4067-9a45-ee2ce680d022-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "cinder-7b62f7ef-9fcc-4471-a1ce-983498c26869-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-7b62f7ef-9fcc-4471-a1ce-983498c26869-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "cinder-quobyte-7b62f7ef-9fcc-4471-a1ce-983498c26869" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-quobyte-7b62f7ef-9fcc-4471-a1ce-983498c26869" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[418fba00-6019-493d-ba1d-ecfed0449d0c]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b62f7ef-9fcc-4471-a1ce-983498c26869 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:57 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b62f7ef-9fcc-4471-a1ce-983498c26869 Apr 15 10:10:57 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-098421c9-9e83-4e3c-b1d1-1c62c9f64945 tempest-GroupSnapshotsTest-1684095675 None] Update group completed successfully. Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] Creating offline snapshot 912b2d4e-9003-4fba-ac00-50597a1eaaf5 of volume ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cb6279-af36-48db-b49c-000d7ff11511]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:57 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 Apr 15 10:10:57 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:57 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b62f7ef-9fcc-4471-a1ce-983498c26869" returned: 0 in 0.519s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b62f7ef-9fcc-4471-a1ce-983498c26869 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:57 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b62f7ef-9fcc-4471-a1ce-983498c26869 Apr 15 10:10:57 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:58 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0" returned: 0 in 0.507s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:58 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 1G Apr 15 10:10:58 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:58 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b62f7ef-9fcc-4471-a1ce-983498c26869" returned: 0 in 0.410s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-quobyte-7b62f7ef-9fcc-4471-a1ce-983498c26869" released by "delete_volume" :: held 0.959s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Created reservations ['71bd0f06-7da2-4e60-b94f-ce7f8022581c', 'b264ff67-f6c2-485b-a2a7-1c616ff1a1d3', 'f7815a9e-aa1f-4a9e-ba90-4a0b0a964189', '406ee776-a9d4-498c-8672-a75dfe5654e9'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:58 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:58 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "cinder-e28de240-995b-4a3d-a7d7-6000e2947378-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-e28de240-995b-4a3d-a7d7-6000e2947378-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "cinder-quobyte-e28de240-995b-4a3d-a7d7-6000e2947378" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-quobyte-e28de240-995b-4a3d-a7d7-6000e2947378" acquired by "delete_volume" :: waited 0.036s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe38f44-04af-4eba-afe4-cea725b00081]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e28de240-995b-4a3d-a7d7-6000e2947378 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:58 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a2adc2d3-3465-4d18-bce5-47dbbd3bb7d8 tempest-GroupSnapshotsTest-1684095675 None] Update group completed successfully. Apr 15 10:10:58 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 1G" returned: 0 in 0.659s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:58 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e28de240-995b-4a3d-a7d7-6000e2947378 Apr 15 10:10:58 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:58 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 Apr 15 10:10:58 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:59 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.600s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Deleted volume successfully. Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d43f393d-78dc-4baf-abe9-d92189bacefe tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-7b62f7ef-9fcc-4471-a1ce-983498c26869-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:59 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e28de240-995b-4a3d-a7d7-6000e2947378" returned: 0 in 0.543s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e28de240-995b-4a3d-a7d7-6000e2947378 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:59 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e28de240-995b-4a3d-a7d7-6000e2947378 Apr 15 10:10:59 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:59 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5" returned: 0 in 0.476s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:59 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 is being set with open permissions: ugo+rw Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:59 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 Apr 15 10:10:59 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:59 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e28de240-995b-4a3d-a7d7-6000e2947378" returned: 0 in 0.428s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-quobyte-e28de240-995b-4a3d-a7d7-6000e2947378" released by "delete_volume" :: held 1.002s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Created reservations ['f7b4b799-01e9-4a3c-917f-39641bc0b397', 'b7d6054c-73cb-469c-8a5d-6c54f2d202a3', 'cf22b341-62cc-486d-ae4e-780b528060ef', '4133f932-5ad6-450b-bdc4-2dd1cac1b839'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:59 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5" returned: 0 in 0.489s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:59 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:10:59 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:59 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.info Apr 15 10:10:59 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7147a63e-a3c6-4ede-986b-f9bd5d621d04 tempest-GroupSnapshotsTest-1684095675 None] Update group completed successfully. Apr 15 10:11:00 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.info" returned: 0 in 0.408s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:00 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.info is being set with open permissions: ugo+rw Apr 15 10:11:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:00 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.430s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:00 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:00 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Deleted volume successfully. Apr 15 10:11:00 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.info Apr 15 10:11:00 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-fd1c32a7-fd25-4186-bcba-c61c1452906f tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-e28de240-995b-4a3d-a7d7-6000e2947378-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:00 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.info" returned: 0 in 0.422s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.031s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:00 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-454d6ad4-8d5f-4112-b7c6-8bd292cc2a5f tempest-SnapshotMetadataTestJSON-1714798066 None] Create snapshot completed successfully Apr 15 10:11:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "cinder-e0dc85ca-54ad-414c-838c-c7072abd7239-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-e0dc85ca-54ad-414c-838c-c7072abd7239-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "cinder-quobyte-e0dc85ca-54ad-414c-838c-c7072abd7239" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-quobyte-e0dc85ca-54ad-414c-838c-c7072abd7239" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:00 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc1bfce-b039-4e2a-8b19-51101ba003cb]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0dc85ca-54ad-414c-838c-c7072abd7239 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:00 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0dc85ca-54ad-414c-838c-c7072abd7239 Apr 15 10:11:00 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] GroupSnapshot fb30dab6-87d7-4463-9ac5-2e90118f13c8: creating. Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Group snapshot fb30dab6-87d7-4463-9ac5-2e90118f13c8: creating. {{(pid=83167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Creating offline snapshot 303efbce-1521-4fa8-aec0-9a2c414e4230 of volume 31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[71acb615-72b2-42f0-b9bd-060cc25f34c5]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:01 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 Apr 15 10:11:01 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Acquiring lock "cinder-912b2d4e-9003-4fba-ac00-50597a1eaaf5-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "cinder-912b2d4e-9003-4fba-ac00-50597a1eaaf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Acquiring lock "cinder-quobyte-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "cinder-quobyte-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Acquiring lock "cinder-quobyte-912b2d4e-9003-4fba-ac00-50597a1eaaf5" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "cinder-quobyte-912b2d4e-9003-4fba-ac00-50597a1eaaf5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Deleting offline snapshot 912b2d4e-9003-4fba-ac00-50597a1eaaf5 of volume ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] snapshot_file for this snap is: volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5a28c5-82cf-4a32-88e1-6f503ce7eb86]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:01 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 Apr 15 10:11:01 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:01 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0dc85ca-54ad-414c-838c-c7072abd7239" returned: 0 in 0.783s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0dc85ca-54ad-414c-838c-c7072abd7239 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:01 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0dc85ca-54ad-414c-838c-c7072abd7239 Apr 15 10:11:01 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:01 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5" returned: 0 in 0.699s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:02 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 1G Apr 15 10:11:02 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:02 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e0dc85ca-54ad-414c-838c-c7072abd7239" returned: 0 in 0.502s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-quobyte-e0dc85ca-54ad-414c-838c-c7072abd7239" released by "delete_volume" :: held 1.313s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:02 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5" returned: 0 in 0.699s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f60b6f-b7e0-4975-ba2a-7b860dafe590]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Created reservations ['46854929-a508-472e-b9fe-45f71aedae56', 'a53a9fb1-5824-4ed3-b9e4-846924493227', '840366c6-a815-4f71-b075-4b29c84143af', '294d77ac-70a6-41aa-bad7-76a852597c4f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:02 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 Apr 15 10:11:02 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:02 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:11:02 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:02 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 1G" returned: 0 in 0.629s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:02 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 Apr 15 10:11:02 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:02 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.504s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:02 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Deleted volume successfully. Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=234,cinder:INSERT=68,cinder:UPDATE=312,cinder:DELETE=25 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:11:02 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0" returned: 0 in 0.624s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-764fd3cb-de7a-4400-8767-b69271e44f43 tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-e0dc85ca-54ad-414c-838c-c7072abd7239-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:02 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 Apr 15 10:11:02 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "cinder-7f5e18e5-eae2-48f9-9fe6-d55a591d2680-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-7f5e18e5-eae2-48f9-9fe6-d55a591d2680-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=247,cinder:INSERT=77,cinder:UPDATE=317,cinder:DELETE=27 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "cinder-quobyte-7f5e18e5-eae2-48f9-9fe6-d55a591d2680" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-quobyte-7f5e18e5-eae2-48f9-9fe6-d55a591d2680" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79029e0-23c6-41c7-a761-6a95306a5835]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:03 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680 Apr 15 10:11:03 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:03 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230" returned: 0 in 0.574s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:03 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:03 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 Apr 15 10:11:03 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:03 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5" returned: 0 in 0.564s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:03 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5 Apr 15 10:11:03 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:03 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680" returned: 0 in 0.556s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:03 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680 Apr 15 10:11:03 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:03 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230" returned: 0 in 0.442s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:03 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.info Apr 15 10:11:03 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:03 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0.912b2d4e-9003-4fba-ac00-50597a1eaaf5" returned: 0 in 0.436s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "cinder-quobyte-912b2d4e-9003-4fba-ac00-50597a1eaaf5" released by "_delete_snapshot" :: held 2.383s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "cinder-quobyte-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0" released by "delete_snapshot" :: held 2.401s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Created reservations ['20bcef6c-bb6f-4e7c-96cb-5a3a14aa0f36', 'fe90b66d-d218-40b6-b2bd-ddd2bc04d39b', '677d44f5-dab7-4b1f-89c6-abe0378243d1', 'bad02647-335c-4ef1-b4e1-ba52d9287371'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:03 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Delete snapshot completed successfully. Apr 15 10:11:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c5dc4a71-902c-4023-a322-1b2c38869d2f tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "cinder-912b2d4e-9003-4fba-ac00-50597a1eaaf5-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:04 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7f5e18e5-eae2-48f9-9fe6-d55a591d2680" returned: 0 in 0.463s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-quobyte-7f5e18e5-eae2-48f9-9fe6-d55a591d2680" released by "delete_volume" :: held 1.041s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Created reservations ['8b6315d9-907b-4f5f-b1fd-d18c7a09bb3d', '1deace45-7228-418c-af9c-8cc38113c7b9', '589d00c7-c44c-4838-baa6-ff931d42f3c5', 'b25399f8-7cf5-48ee-bde5-ffca0469a138'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:04 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.info" returned: 0 in 0.476s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:04 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:04 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.info Apr 15 10:11:04 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:04 devstack sudo[88267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:11:04 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:04 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.info" returned: 0 in 0.450s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.354s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Creating offline snapshot 6ada96dc-d66d-49a1-82f2-1fd9d3855016 of volume b78dcf01-c31f-4002-89dc-e73df277b6dd {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Acquiring lock "cinder-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cac324-7e53-492f-aaa8-c6c1c14d2acc]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "cinder-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Acquiring lock "cinder-quobyte-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "cinder-quobyte-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:04 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd Apr 15 10:11:04 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:04 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.542s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:04 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Deleted volume successfully. Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5c388f-92db-4194-a3a7-ef1a1454ea08]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-65420118-67cc-45c3-b2d8-76a87b7a5aef tempest-CreateVolumesFromSourceVolumeTest-2111936830 None] Lock "cinder-7f5e18e5-eae2-48f9-9fe6-d55a591d2680-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:04 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 Apr 15 10:11:04 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:05 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd" returned: 0 in 0.478s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:05 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 1G Apr 15 10:11:05 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:05 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0" returned: 0 in 0.509s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:05 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0 Apr 15 10:11:05 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:05 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 1G" returned: 0 in 0.620s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78dcf01-c31f-4002-89dc-e73df277b6dd -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:05 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78dcf01-c31f-4002-89dc-e73df277b6dd -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 Apr 15 10:11:05 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:05 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0" returned: 0 in 0.532s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "cinder-quobyte-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0" released by "delete_volume" :: held 1.087s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Created reservations ['1bb38095-482f-4fe7-a5ba-dae6be71030c', '56c741f2-9dd9-4c63-aa32-de947fd9aadf', '5ede0f42-062c-4f81-bf25-42a23348106e', 'f43baba1-9f35-4506-9efa-6bd1959de916'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:05 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:11:05 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:06 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78dcf01-c31f-4002-89dc-e73df277b6dd -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016" returned: 0 in 0.527s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:06 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:06 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 Apr 15 10:11:06 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:06 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.469s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:06 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Deleted volume successfully. Apr 15 10:11:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-319d4756-3b7f-4558-a26e-5683f8ebb15a tempest-SnapshotMetadataTestJSON-1714798066 None] Lock "cinder-ab3b281c-7dff-4c14-ba66-1dcd8f2a06e0-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:06 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016" returned: 0 in 0.554s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:06 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.info Apr 15 10:11:06 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Flow 'volume_create_manager' (c3f527fb-5258-4bcf-a1ef-b6b4092d60e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3e9f73-bf71-4b4e-bd6d-9c01b0422c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3e9f73-bf71-4b4e-bd6d-9c01b0422c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1395097963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a12745-2434-42d3-b461-ee0af08ab7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f352c3eae2d43f9a0c595122e267b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:07Z,use_quota=True,user_id='5fd89f74a8c64a23aea07328e17efa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30fbb6c-2015-4eb4-9d61-b31c74975031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30fbb6c-2015-4eb4-9d61-b31c74975031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2752afa-2272-4839-adbf-e803af754f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2752afa-2272-4839-adbf-e803af754f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a12745-2434-42d3-b461-ee0af08ab7b2', 'volume_name': 'volume-e2a12745-2434-42d3-b461-ee0af08ab7b2', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a82dce-19f0-4628-b148-290172968f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a82dce-19f0-4628-b148-290172968f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15bd3b3-21af-44df-88fe-35ec4216b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Volume e2a12745-2434-42d3-b461-ee0af08ab7b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a12745-2434-42d3-b461-ee0af08ab7b2', 'volume_size': 1} Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:07 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.info" returned: 0 in 0.664s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:07 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:11:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:07 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.info Apr 15 10:11:07 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:08 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.info" returned: 0 in 0.630s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.534s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1395097963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a12745-2434-42d3-b461-ee0af08ab7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f352c3eae2d43f9a0c595122e267b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:07Z,use_quota=True,user_id='5fd89f74a8c64a23aea07328e17efa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Creating volume e2a12745-2434-42d3-b461-ee0af08ab7b2 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:08 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:08 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 1073741824 Apr 15 10:11:08 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-750246ed-d996-47a1-9476-a564d443efb4 tempest-GroupSnapshotsTest-1684095675 None] group_snapshot fb30dab6-87d7-4463-9ac5-2e90118f13c8: created successfully Apr 15 10:11:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] group_snapshot fb30dab6-87d7-4463-9ac5-2e90118f13c8: deleting Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] group_snapshot fb30dab6-87d7-4463-9ac5-2e90118f13c8: deleting {{(pid=83167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-303efbce-1521-4fa8-aec0-9a2c414e4230" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-303efbce-1521-4fa8-aec0-9a2c414e4230" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Deleting offline snapshot 303efbce-1521-4fa8-aec0-9a2c414e4230 of volume 31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] snapshot_file for this snap is: volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[136ab4a2-b897-4502-9eae-736a988cd41f]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:09 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 1073741824" returned: 0 in 0.827s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:09 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 Apr 15 10:11:09 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:09 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 Apr 15 10:11:09 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3753f02d-13c9-434a-8f6d-1844f4cae7b5 tempest-VolumesActionsTest-753798396 None] Acquiring lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d" by "attach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3753f02d-13c9-434a-8f6d-1844f4cae7b5 tempest-VolumesActionsTest-753798396 None] Lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d" acquired by "attach_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3753f02d-13c9-434a-8f6d-1844f4cae7b5 tempest-VolumesActionsTest-753798396 None] Attaching volume 655e5274-5f96-4d9d-8ff7-b79e82f2523d to instance 96265732-2bcf-4f0a-b94c-790f89a50bef at mountpoint /dev/vdb on host None. Apr 15 10:11:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3753f02d-13c9-434a-8f6d-1844f4cae7b5 tempest-VolumesActionsTest-753798396 None] Attach volume completed successfully. Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3753f02d-13c9-434a-8f6d-1844f4cae7b5 tempest-VolumesActionsTest-753798396 None] Lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d" released by "attach_volume" :: held 0.080s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:09 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2" returned: 0 in 0.608s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15bd3b3-21af-44df-88fe-35ec4216b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a12745-2434-42d3-b461-ee0af08ab7b2', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f151d8-2e1d-46dc-aa04-d37fda985c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:09 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Volume volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 (e2a12745-2434-42d3-b461-ee0af08ab7b2): created successfully Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f151d8-2e1d-46dc-aa04-d37fda985c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Flow 'volume_create_manager' (c3f527fb-5258-4bcf-a1ef-b6b4092d60e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a296fbb0-5d46-45b1-a528-b395e9cd1d4e tempest-VolumeDependencyTests-304943600 None] Created volume successfully. Apr 15 10:11:09 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230" returned: 0 in 0.823s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fa74af-35ad-48bf-84f1-bb11c4a342f4]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:09 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 Apr 15 10:11:09 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7b01de97-4b92-4265-83b8-47c70bda3fcd tempest-VolumesActionsTest-753798396 None] Acquiring lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d-detach_volume" by "detach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7b01de97-4b92-4265-83b8-47c70bda3fcd tempest-VolumesActionsTest-753798396 None] Lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7b01de97-4b92-4265-83b8-47c70bda3fcd tempest-VolumesActionsTest-753798396 None] Detaching volume 655e5274-5f96-4d9d-8ff7-b79e82f2523d from instance 96265732-2bcf-4f0a-b94c-790f89a50bef. Apr 15 10:11:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7b01de97-4b92-4265-83b8-47c70bda3fcd tempest-VolumesActionsTest-753798396 None] Detach volume completed successfully. Apr 15 10:11:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7b01de97-4b92-4265-83b8-47c70bda3fcd tempest-VolumesActionsTest-753798396 None] Lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:10 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5" returned: 0 in 0.643s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:10 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 Apr 15 10:11:10 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] Creating offline snapshot b713052d-0eba-4c91-88a0-572f217f5d2e of volume e2a12745-2434-42d3-b461-ee0af08ab7b2 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00537e9-fb48-4c3a-824b-070f5baaca67]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:11 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 Apr 15 10:11:11 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:11 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230" returned: 0 in 0.687s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:11 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230 Apr 15 10:11:11 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Flow 'volume_create_manager' (89786ae2-5b8e-49db-86ad-f670357fb7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f076d5c-c5f7-49c1-967e-1357fc10408d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f076d5c-c5f7-49c1-967e-1357fc10408d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-528994729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fc9117-58d6-4505-bdac-65711f0f79bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1739704bd6ff44e98482d686b5299ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:11Z,use_quota=True,user_id='c2ced848f7154cdeb7a04cb30e8f1afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae60eb2f-fcfc-4fa6-9791-4124c30880c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae60eb2f-fcfc-4fa6-9791-4124c30880c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cd740f-fde0-4938-8d70-63384f5005be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cd740f-fde0-4938-8d70-63384f5005be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5fc9117-58d6-4505-bdac-65711f0f79bc', 'volume_name': 'volume-b5fc9117-58d6-4505-bdac-65711f0f79bc', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de0b838-4a34-4616-902b-ab4b351aafba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de0b838-4a34-4616-902b-ab4b351aafba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3621b75c-c5fe-4f25-9cb4-7c77282214cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:11 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Volume b5fc9117-58d6-4505-bdac-65711f0f79bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5fc9117-58d6-4505-bdac-65711f0f79bc', 'volume_size': 1} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:11 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2" returned: 0 in 0.707s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:11 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e 1G Apr 15 10:11:11 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:11 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5.303efbce-1521-4fa8-aec0-9a2c414e4230" returned: 0 in 0.521s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-303efbce-1521-4fa8-aec0-9a2c414e4230" released by "_delete_snapshot" :: held 2.751s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5" released by "delete_snapshot" :: held 2.784s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-b78dcf01-c31f-4002-89dc-e73df277b6dd" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-b78dcf01-c31f-4002-89dc-e73df277b6dd" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-6ada96dc-d66d-49a1-82f2-1fd9d3855016" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-6ada96dc-d66d-49a1-82f2-1fd9d3855016" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Deleting offline snapshot 6ada96dc-d66d-49a1-82f2-1fd9d3855016 of volume b78dcf01-c31f-4002-89dc-e73df277b6dd {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] snapshot_file for this snap is: volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39e9856-e8f2-4063-851a-5d8d3511acc5]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:11 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 Apr 15 10:11:11 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:12 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e 1G" returned: 0 in 0.589s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:12 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e Apr 15 10:11:12 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:12 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016" returned: 0 in 0.643s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78dcf01-c31f-4002-89dc-e73df277b6dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ccd00c-7f89-4e90-9298-4e83de7df91d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:12 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd Apr 15 10:11:12 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:12 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e" returned: 0 in 0.474s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:12 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e is being set with open permissions: ugo+rw Apr 15 10:11:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:12 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e Apr 15 10:11:12 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:12 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd" returned: 0 in 0.481s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:12 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 Apr 15 10:11:12 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:13 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e" returned: 0 in 0.417s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:13 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.info Apr 15 10:11:13 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:13 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016" returned: 0 in 0.531s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:13 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016 Apr 15 10:11:13 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:13 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.info" returned: 0 in 0.530s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:13 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.info is being set with open permissions: ugo+rw Apr 15 10:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:13 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.info Apr 15 10:11:13 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:13 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd.6ada96dc-d66d-49a1-82f2-1fd9d3855016" returned: 0 in 0.521s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-6ada96dc-d66d-49a1-82f2-1fd9d3855016" released by "_delete_snapshot" :: held 2.229s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-b78dcf01-c31f-4002-89dc-e73df277b6dd" released by "delete_snapshot" :: held 2.243s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:13 devstack cinder-volume[83167]: WARNING cinder.quota [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-40025121 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-40025121, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:13 devstack cinder-volume[83167]: WARNING cinder.quota [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-40025121 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-40025121, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:13 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Created reservations ['79f863a8-1cf2-49e1-b396-e6401713be77', '2cb6547a-3ec5-443b-bd0c-5deba664e4ba', 'f65594c1-7122-4e3d-b111-01886dbdbefd', '7c355281-61cb-4af7-8e59-8c4ef974ab5b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:14 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.info" returned: 0 in 0.453s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.236s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.567s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-528994729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fc9117-58d6-4505-bdac-65711f0f79bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1739704bd6ff44e98482d686b5299ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:11Z,use_quota=True,user_id='c2ced848f7154cdeb7a04cb30e8f1afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Creating volume b5fc9117-58d6-4505-bdac-65711f0f79bc {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:14 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] Created reservations ['a072d22d-c553-4872-8409-b11f155c1c6d', 'b7848a2e-2c2e-40e5-9491-8bef2b66ceb3', '14f04aa7-0a9a-4c34-a049-67a68721e39b', 'bf4ab421-5a54-44db-95a8-c263796a331b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:14 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc 1073741824 Apr 15 10:11:14 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f094e993-644f-437d-aaf7-9d2deefd8a01 tempest-VolumeDependencyTests-304943600 None] Create snapshot completed successfully Apr 15 10:11:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-808c5fce-315d-45f7-9e63-3b20ad23b1f5 tempest-GroupSnapshotsTest-1684095675 None] group_snapshot fb30dab6-87d7-4463-9ac5-2e90118f13c8: deleted successfully Apr 15 10:11:14 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc 1073741824" returned: 0 in 0.575s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:14 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc Apr 15 10:11:14 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:15 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc" returned: 0 in 0.437s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3621b75c-c5fe-4f25-9cb4-7c77282214cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5fc9117-58d6-4505-bdac-65711f0f79bc', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b37f5fb-4eee-4e4d-96f3-7aa894e231f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:15 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Volume volume-b5fc9117-58d6-4505-bdac-65711f0f79bc (b5fc9117-58d6-4505-bdac-65711f0f79bc): created successfully Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b37f5fb-4eee-4e4d-96f3-7aa894e231f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Flow 'volume_create_manager' (89786ae2-5b8e-49db-86ad-f670357fb7a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-dc90f993-6b61-4f44-971b-f661e2205c97 tempest-VolumesDeleteCascade-1438081154 None] Created volume successfully. Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Flow 'volume_create_manager' (40c2f608-56b8-4dc0-9322-a0d3784af776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badfa1ae-4de2-4c6f-a859-f162eea7de02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badfa1ae-4de2-4c6f-a859-f162eea7de02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1814092141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73975f01-fc88-497b-9450-283aec229a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f352c3eae2d43f9a0c595122e267b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b713052d-0eba-4c91-88a0-572f217f5d2e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:15Z,use_quota=True,user_id='5fd89f74a8c64a23aea07328e17efa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a311e6-228a-4086-8168-fcbfa43eebb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a311e6-228a-4086-8168-fcbfa43eebb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25021fc1-7ad6-4c64-abdb-b90c70308375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25021fc1-7ad6-4c64-abdb-b90c70308375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '73975f01-fc88-497b-9450-283aec229a80', 'volume_name': 'volume-73975f01-fc88-497b-9450-283aec229a80', 'volume_size': 1, 'snapshot_id': 'b713052d-0eba-4c91-88a0-572f217f5d2e'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4197b3-63c3-4b49-b83d-e4589f4493dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4197b3-63c3-4b49-b83d-e4589f4493dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5c96c6-7ae6-4026-9219-1c8a22846fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:15 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Volume 73975f01-fc88-497b-9450-283aec229a80: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-73975f01-fc88-497b-9450-283aec229a80', 'volume_size': 1, 'snapshot_id': 'b713052d-0eba-4c91-88a0-572f217f5d2e'} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-quobyte-b713052d-0eba-4c91-88a0-572f217f5d2e-73975f01-fc88-497b-9450-283aec229a80" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-b713052d-0eba-4c91-88a0-572f217f5d2e-73975f01-fc88-497b-9450-283aec229a80" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Creating volume 73975f01-fc88-497b-9450-283aec229a80 from snapshot b713052d-0eba-4c91-88a0-572f217f5d2e {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-quobyte-73975f01-fc88-497b-9450-283aec229a80" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-73975f01-fc88-497b-9450-283aec229a80" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] snapshot: b713052d-0eba-4c91-88a0-572f217f5d2e, volume: 73975f01-fc88-497b-9450-283aec229a80, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5" acquired by "delete_volume" :: waited 0.033s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[887265f2-59b9-4c07-a424-ea2de974780e]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6be5154-2514-42a8-bc76-574196f1a932]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:15 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e Apr 15 10:11:15 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:15 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 Apr 15 10:11:15 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:16 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5" returned: 0 in 0.541s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:16 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5 Apr 15 10:11:16 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:16 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e" returned: 0 in 0.563s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2a12745-2434-42d3-b461-ee0af08ab7b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] will copy from snapshot at /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5974bf5f-782b-4f69-a8eb-5adeb3e39746]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:16 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 Apr 15 10:11:16 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:16 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5" returned: 0 in 0.445s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-31d0f84c-13ef-4e68-bcc7-ba81f6128bb5" released by "delete_volume" :: held 1.031s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-b78dcf01-c31f-4002-89dc-e73df277b6dd" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-b78dcf01-c31f-4002-89dc-e73df277b6dd" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbd9d30-7af8-423b-99f5-1f1f07ae9a9b]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:16 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd Apr 15 10:11:16 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:16 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2" returned: 0 in 0.523s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Path /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:11:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:16 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80 Apr 15 10:11:16 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:17 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd" returned: 0 in 0.567s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:17 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd Apr 15 10:11:17 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:18 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b78dcf01-c31f-4002-89dc-e73df277b6dd" returned: 0 in 1.268s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-b78dcf01-c31f-4002-89dc-e73df277b6dd" released by "delete_volume" :: held 1.873s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:18 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Created reservations ['5a3890f2-5949-42ad-9ae5-b09962644ac5'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:18 devstack cinder-volume[83167]: WARNING cinder.quota [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-40025121 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-40025121, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:18 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Created reservations ['ecce3c25-c1c5-40f0-a21c-9dfdb6aca4c6', '2df89507-9f3a-4a1c-801a-9a87bb444e13', '705a1f92-1d42-408b-8352-c27cc58a90b6', '35a11499-f49c-4af3-a0c3-27319cac68f7'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:18 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Created reservations ['b8f34792-8cbe-45d7-94d6-7f6a3296be72', '5b56570b-af5c-4ea3-bebf-70f4daa7931a', 'c3b50a76-d682-4d19-bc36-ab467a6b40df', 'b9edbfc8-20d4-4423-b5a4-5417d24fc7be'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:18 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:11:18 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:19 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80" returned: 0 in 2.426s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:19 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c846b2-9dd2-4ef6-8559-32c8197df94d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:19 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 Apr 15 10:11:19 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:19 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.388s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:19 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c022c889-97dd-43b0-99a9-839f81584203 tempest-GroupSnapshotsTest-1684095675 None] Delete group completed successfully. Apr 15 10:11:19 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2" returned: 0 in 0.576s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:19 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2, size 1024.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:11:19 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Converted 1024.00 MB image at 421.94 MB/s Apr 15 10:11:19 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80 is being set with open permissions: ugo+rw Apr 15 10:11:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:19 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80 Apr 15 10:11:19 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:20 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80" returned: 0 in 0.397s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-73975f01-fc88-497b-9450-283aec229a80" released by "_copy_volume_from_snapshot" :: held 4.572s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-b713052d-0eba-4c91-88a0-572f217f5d2e-73975f01-fc88-497b-9450-283aec229a80" released by "_create_volume_from_snapshot" :: held 4.592s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.630s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.205s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] Creating offline snapshot 3faeccac-8e14-4cea-901e-dd1351424ac6 of volume b5fc9117-58d6-4505-bdac-65711f0f79bc {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[af70c174-22cd-4d3a-8425-68745d719599]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5c96c6-7ae6-4026-9219-1c8a22846fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73975f01-fc88-497b-9450-283aec229a80', 'volume_size': 1, 'snapshot_id': 'b713052d-0eba-4c91-88a0-572f217f5d2e'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd39954-c593-4d36-9809-069575262184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:20 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Volume volume-73975f01-fc88-497b-9450-283aec229a80 (73975f01-fc88-497b-9450-283aec229a80): created successfully Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd39954-c593-4d36-9809-069575262184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Flow 'volume_create_manager' (40c2f608-56b8-4dc0-9322-a0d3784af776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-034f830b-fce5-4563-9b5f-f0bc95ca3134 tempest-VolumeDependencyTests-304943600 None] Created volume successfully. Apr 15 10:11:20 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc Apr 15 10:11:20 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-955cca81-cb01-461b-9d19-96350ac96a23 tempest-GroupSnapshotsTest-1684095675 None] Group tempest-GroupSnapshotsTest-Group-1813893697: creating Apr 15 10:11:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-955cca81-cb01-461b-9d19-96350ac96a23 tempest-GroupSnapshotsTest-1684095675 None] Group tempest-GroupSnapshotsTest-Group-1813893697: created successfully Apr 15 10:11:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-955cca81-cb01-461b-9d19-96350ac96a23 tempest-GroupSnapshotsTest-1684095675 None] Create group completed successfully. Apr 15 10:11:20 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc" returned: 0 in 0.495s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:20 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 1G Apr 15 10:11:20 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-b713052d-0eba-4c91-88a0-572f217f5d2e-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-b713052d-0eba-4c91-88a0-572f217f5d2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-quobyte-e2a12745-2434-42d3-b461-ee0af08ab7b2" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-e2a12745-2434-42d3-b461-ee0af08ab7b2" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-quobyte-b713052d-0eba-4c91-88a0-572f217f5d2e" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-b713052d-0eba-4c91-88a0-572f217f5d2e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Deleting offline snapshot b713052d-0eba-4c91-88a0-572f217f5d2e of volume e2a12745-2434-42d3-b461-ee0af08ab7b2 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] snapshot_file for this snap is: volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d79820-7bc8-495f-a84c-e4d88fb76142]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:20 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e Apr 15 10:11:20 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:21 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 1G" returned: 0 in 0.472s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5fc9117-58d6-4505-bdac-65711f0f79bc -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:21 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5fc9117-58d6-4505-bdac-65711f0f79bc -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 Apr 15 10:11:21 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:21 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e" returned: 0 in 0.524s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2a12745-2434-42d3-b461-ee0af08ab7b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e44e95-acbd-47e0-81c8-2260b4b12da2]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:21 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 Apr 15 10:11:21 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:21 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5fc9117-58d6-4505-bdac-65711f0f79bc -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6" returned: 0 in 0.481s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:21 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 is being set with open permissions: ugo+rw Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:21 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 Apr 15 10:11:21 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Flow 'volume_create_manager' (d7c22a14-76fd-4444-a130-8b75c89fb420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50689d85-5ca8-4c23-95e3-86a0d3fe5138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50689d85-5ca8-4c23-95e3-86a0d3fe5138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381312835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d76ba240-ce72-4649-b696-5dfe71894044,host='devstack@QuobyteHD#QuobyteHD',id=f1092093-263c-4d2b-b807-84d2056874e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5933ebf5bb8472fa36563cd0009d3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:22Z,use_quota=True,user_id='120e1cfec1a44d7291b7602661878181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf2c2f13-8d56-4b7b-a99f-ed16a4560d5b),volume_type_id=bf2c2f13-8d56-4b7b-a99f-ed16a4560d5b)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b7c86f-51fe-4413-9bc9-bd3053f3d5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b7c86f-51fe-4413-9bc9-bd3053f3d5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1f3011-65a4-4105-a591-064d8de0be9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1f3011-65a4-4105-a591-064d8de0be9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1092093-263c-4d2b-b807-84d2056874e4', 'volume_name': 'volume-f1092093-263c-4d2b-b807-84d2056874e4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa0f87c-7478-4519-82b3-0147b5154788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa0f87c-7478-4519-82b3-0147b5154788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a78aac3-aae5-4557-864f-0537ffef739c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:21 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Volume f1092093-263c-4d2b-b807-84d2056874e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1092093-263c-4d2b-b807-84d2056874e4', 'volume_size': 1} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:21 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2" returned: 0 in 0.577s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:21 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e Apr 15 10:11:21 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:21 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6" returned: 0 in 0.459s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:22 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.info Apr 15 10:11:22 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:22 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e" returned: 0 in 0.521s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:22 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e Apr 15 10:11:22 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:22 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.info" returned: 0 in 0.566s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:22 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.info is being set with open permissions: ugo+rw Apr 15 10:11:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:22 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.info Apr 15 10:11:22 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:22 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2.b713052d-0eba-4c91-88a0-572f217f5d2e" returned: 0 in 0.529s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-b713052d-0eba-4c91-88a0-572f217f5d2e" released by "_delete_snapshot" :: held 2.219s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-e2a12745-2434-42d3-b461-ee0af08ab7b2" released by "delete_snapshot" :: held 2.233s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:22 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Created reservations ['42b5d926-9eeb-4f3f-bfe4-e0769e32cce7', 'e65354aa-9200-4d77-a42b-2b505091d673', 'bd37ee81-ffc8-4077-8564-0879f9bd4140', 'ace6b328-d7ad-4030-b3df-3f2ba664575c'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Delete snapshot completed successfully. Apr 15 10:11:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0cd31a9d-24ca-4fe4-872c-cdae88689812 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-b713052d-0eba-4c91-88a0-572f217f5d2e-delete_snapshot" released by "delete_snapshot" :: held 2.334s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:23 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.info" returned: 0 in 0.485s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.022s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.341s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d76ba240-ce72-4649-b696-5dfe71894044,created_at=2026-04-15T08:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381312835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d76ba240-ce72-4649-b696-5dfe71894044,host='devstack@QuobyteHD#QuobyteHD',id=f1092093-263c-4d2b-b807-84d2056874e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5933ebf5bb8472fa36563cd0009d3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:22Z,use_quota=True,user_id='120e1cfec1a44d7291b7602661878181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf2c2f13-8d56-4b7b-a99f-ed16a4560d5b),volume_type_id=bf2c2f13-8d56-4b7b-a99f-ed16a4560d5b)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Creating volume f1092093-263c-4d2b-b807-84d2056874e4 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:23 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:23 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4 1073741824 Apr 15 10:11:23 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-07f31a6b-2d83-4736-a8c4-f34d5aed8344 tempest-VolumesDeleteCascade-1438081154 None] Create snapshot completed successfully Apr 15 10:11:23 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4 1073741824" returned: 0 in 0.558s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:23 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4 Apr 15 10:11:23 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-e2a12745-2434-42d3-b461-ee0af08ab7b2-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-e2a12745-2434-42d3-b461-ee0af08ab7b2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-quobyte-e2a12745-2434-42d3-b461-ee0af08ab7b2" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-e2a12745-2434-42d3-b461-ee0af08ab7b2" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de28324-61f3-474d-931f-cfe6f7535d95]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:23 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 Apr 15 10:11:23 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:24 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4" returned: 0 in 0.511s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a78aac3-aae5-4557-864f-0537ffef739c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1092093-263c-4d2b-b807-84d2056874e4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a42185-c16b-4b97-8148-4d10b8e58f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:24 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Volume volume-f1092093-263c-4d2b-b807-84d2056874e4 (f1092093-263c-4d2b-b807-84d2056874e4): created successfully Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a42185-c16b-4b97-8148-4d10b8e58f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Flow 'volume_create_manager' (d7c22a14-76fd-4444-a130-8b75c89fb420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f5678903-f692-4980-9eac-2599e052d28d tempest-GroupSnapshotsTest-1684095675 None] Created volume successfully. Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] Creating offline snapshot ddeac767-ec13-418b-a317-5f018fede5ab of volume b5fc9117-58d6-4505-bdac-65711f0f79bc {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6946862e-7a1a-4d34-9588-25885eecdc09]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:24 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2" returned: 0 in 0.535s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:24 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 Apr 15 10:11:24 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:24 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2 Apr 15 10:11:24 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:24 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6" returned: 0 in 0.464s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5fc9117-58d6-4505-bdac-65711f0f79bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:24 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab 1G Apr 15 10:11:24 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:24 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e2a12745-2434-42d3-b461-ee0af08ab7b2" returned: 0 in 0.441s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-e2a12745-2434-42d3-b461-ee0af08ab7b2" released by "delete_volume" :: held 1.010s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Created reservations ['22b7a0fa-f440-4928-9419-fce50adeb5c3', 'a4273841-58d1-4495-ac65-585748c3263c', '402a5329-f955-45ef-a355-8eaba91731f0', 'cf88cf0e-e747-4b19-8573-9ba2941e26ac'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:24 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:11:24 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] GroupSnapshot 6ec1e907-0252-4732-aa71-71254257ae32: creating. Apr 15 10:11:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] Group snapshot 6ec1e907-0252-4732-aa71-71254257ae32: creating. {{(pid=83167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 10:11:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:25 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab 1G" returned: 0 in 0.530s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:25 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab Apr 15 10:11:25 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:25 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.476s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:25 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Deleted volume successfully. Apr 15 10:11:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-423e6796-0bda-4562-889c-f09de2c26920 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-e2a12745-2434-42d3-b461-ee0af08ab7b2-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:25 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab" returned: 0 in 0.480s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:25 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab is being set with open permissions: ugo+rw Apr 15 10:11:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:25 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab Apr 15 10:11:25 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Flow 'volume_create_manager' (eaf6d2e5-db2a-41ba-8f4e-277c0de09a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c49456-7577-449f-a70d-dc75b9b9326f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:26 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c49456-7577-449f-a70d-dc75b9b9326f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1240446504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4b725f-4b41-4df3-8b0f-6be13eac30d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f352c3eae2d43f9a0c595122e267b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:26Z,use_quota=True,user_id='5fd89f74a8c64a23aea07328e17efa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aaf3c15-29d7-4be3-99ee-d627892e342c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aaf3c15-29d7-4be3-99ee-d627892e342c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3f2337-25cd-4f54-b052-30360c9bd576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3f2337-25cd-4f54-b052-30360c9bd576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f4b725f-4b41-4df3-8b0f-6be13eac30d6', 'volume_name': 'volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f8c2b8-4a27-41e6-98e5-124e0c70ffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f8c2b8-4a27-41e6-98e5-124e0c70ffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98214807-4e63-4b92-a25f-8f06affa6e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:26 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Volume 9f4b725f-4b41-4df3-8b0f-6be13eac30d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6', 'volume_size': 1} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab" returned: 0 in 0.475s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.257s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] Creating offline snapshot eaef630d-5ef6-4ffd-8fdb-59c4c1214fae of volume f1092093-263c-4d2b-b807-84d2056874e4 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4b92ff55-338d-4e69-8ab1-954b1ba31598 tempest-VolumesDeleteCascade-1438081154 None] Create snapshot completed successfully Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[437e43de-410b-49e3-b758-0bbbf223feda]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:26 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4 Apr 15 10:11:26 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-b5fc9117-58d6-4505-bdac-65711f0f79bc-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-b5fc9117-58d6-4505-bdac-65711f0f79bc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Performing cascade delete. {{(pid=83167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-3faeccac-8e14-4cea-901e-dd1351424ac6-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-3faeccac-8e14-4cea-901e-dd1351424ac6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-quobyte-b5fc9117-58d6-4505-bdac-65711f0f79bc" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-b5fc9117-58d6-4505-bdac-65711f0f79bc" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-quobyte-3faeccac-8e14-4cea-901e-dd1351424ac6" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-3faeccac-8e14-4cea-901e-dd1351424ac6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Deleting offline snapshot 3faeccac-8e14-4cea-901e-dd1351424ac6 of volume b5fc9117-58d6-4505-bdac-65711f0f79bc {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] snapshot_file for this snap is: volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a8d522-8d07-4c19-878c-d54d12172958]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:26 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 Apr 15 10:11:26 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:26 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4" returned: 0 in 0.484s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:26 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae 1G Apr 15 10:11:26 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:27 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6" returned: 0 in 0.506s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5fc9117-58d6-4505-bdac-65711f0f79bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:27 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c820da-4671-4133-ae19-1dbc98b7df9b]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:27 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc Apr 15 10:11:27 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:27 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae 1G" returned: 0 in 0.507s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1092093-263c-4d2b-b807-84d2056874e4 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:27 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1092093-263c-4d2b-b807-84d2056874e4 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae Apr 15 10:11:27 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:27 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc" returned: 0 in 0.530s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:27 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd50f29-182c-4197-9f94-54f7d4b30411]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:27 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab Apr 15 10:11:27 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:27 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1092093-263c-4d2b-b807-84d2056874e4 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae" returned: 0 in 0.454s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:27 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:11:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:27 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae Apr 15 10:11:27 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:28 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab" returned: 0 in 0.664s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5fc9117-58d6-4505-bdac-65711f0f79bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:28 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae" returned: 0 in 0.506s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:28 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b6da9a-43c7-4733-ae18-088f25647679]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:28 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.info Apr 15 10:11:28 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:28 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 Apr 15 10:11:28 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:28 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.info" returned: 0 in 0.589s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:28 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:11:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:28 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.info Apr 15 10:11:28 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:28 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6" returned: 0 in 0.675s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5fc9117-58d6-4505-bdac-65711f0f79bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:28 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8290cb-801a-4e9b-8064-4dd63e81a3e4]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:29 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc Apr 15 10:11:29 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:29 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.info" returned: 0 in 0.497s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.112s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.132s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1240446504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4b725f-4b41-4df3-8b0f-6be13eac30d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f352c3eae2d43f9a0c595122e267b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:26Z,use_quota=True,user_id='5fd89f74a8c64a23aea07328e17efa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Creating volume 9f4b725f-4b41-4df3-8b0f-6be13eac30d6 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:29 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:29 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 1073741824 Apr 15 10:11:29 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2a81357d-e81a-405b-bc86-bf2fa4f148ee tempest-GroupSnapshotsTest-1684095675 None] group_snapshot 6ec1e907-0252-4732-aa71-71254257ae32: created successfully Apr 15 10:11:29 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc" returned: 0 in 0.580s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:29 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 Apr 15 10:11:29 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:29 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 1073741824" returned: 0 in 0.576s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:30 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:30 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6" returned: 0 in 0.484s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:30 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:30 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6 Apr 15 10:11:30 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] group_snapshot 6ec1e907-0252-4732-aa71-71254257ae32: deleting Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] group_snapshot 6ec1e907-0252-4732-aa71-71254257ae32: deleting {{(pid=83167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-f1092093-263c-4d2b-b807-84d2056874e4" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-f1092093-263c-4d2b-b807-84d2056874e4" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-eaef630d-5ef6-4ffd-8fdb-59c4c1214fae" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-eaef630d-5ef6-4ffd-8fdb-59c4c1214fae" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Deleting offline snapshot eaef630d-5ef6-4ffd-8fdb-59c4c1214fae of volume f1092093-263c-4d2b-b807-84d2056874e4 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] snapshot_file for this snap is: volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a731665-a850-46fe-a8d5-54c28bfc3b17]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:30 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae Apr 15 10:11:30 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:30 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.3faeccac-8e14-4cea-901e-dd1351424ac6" returned: 0 in 0.561s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5fc9117-58d6-4505-bdac-65711f0f79bc /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab -F qcow2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:30 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5fc9117-58d6-4505-bdac-65711f0f79bc /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab -F qcow2 Apr 15 10:11:30 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:30 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6" returned: 0 in 0.748s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98214807-4e63-4b92-a25f-8f06affa6e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfce2f3-01a3-47a4-b7b2-546f54587cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:30 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Volume volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 (9f4b725f-4b41-4df3-8b0f-6be13eac30d6): created successfully Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfce2f3-01a3-47a4-b7b2-546f54587cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Flow 'volume_create_manager' (eaf6d2e5-db2a-41ba-8f4e-277c0de09a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e6febcb6-67fc-465d-b750-a02ba67858fa tempest-VolumesActionsTest-753798396 None] Acquiring lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d" by "attach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0382b93a-bc9e-4a81-8956-27951fbc7932 tempest-VolumeDependencyTests-304943600 None] Created volume successfully. Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e6febcb6-67fc-465d-b750-a02ba67858fa tempest-VolumesActionsTest-753798396 None] Lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d" acquired by "attach_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e6febcb6-67fc-465d-b750-a02ba67858fa tempest-VolumesActionsTest-753798396 None] Attaching volume 655e5274-5f96-4d9d-8ff7-b79e82f2523d to instance 0c04fc00-7248-462f-8158-a6e5f10c44f5 at mountpoint /dev/vdb on host None. Apr 15 10:11:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e6febcb6-67fc-465d-b750-a02ba67858fa tempest-VolumesActionsTest-753798396 None] Attach volume completed successfully. Apr 15 10:11:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e6febcb6-67fc-465d-b750-a02ba67858fa tempest-VolumesActionsTest-753798396 None] Lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d" released by "attach_volume" :: held 0.122s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:31 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae" returned: 0 in 0.576s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1092093-263c-4d2b-b807-84d2056874e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17499e7-b73d-45ca-98fe-cde0c4f2dbea]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:31 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4 Apr 15 10:11:31 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:31 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5fc9117-58d6-4505-bdac-65711f0f79bc /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab -F qcow2" returned: 0 in 0.549s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-3faeccac-8e14-4cea-901e-dd1351424ac6" released by "_delete_snapshot" :: held 4.654s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-b5fc9117-58d6-4505-bdac-65711f0f79bc" released by "delete_snapshot" :: held 4.671s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Created reservations ['3ef58489-5761-4c76-9741-50b3415a32e0', '521dc96a-879d-4530-8311-3d061664a671', '8b087c22-b16c-4a7a-8d11-11c8fab5277b', '39aa6ac8-4dd9-4a63-82e0-d3169edb36a1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Delete snapshot completed successfully. Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-3faeccac-8e14-4cea-901e-dd1351424ac6-delete_snapshot" released by "delete_snapshot" :: held 4.762s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-ddeac767-ec13-418b-a317-5f018fede5ab-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-ddeac767-ec13-418b-a317-5f018fede5ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-quobyte-b5fc9117-58d6-4505-bdac-65711f0f79bc" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-b5fc9117-58d6-4505-bdac-65711f0f79bc" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-quobyte-ddeac767-ec13-418b-a317-5f018fede5ab" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-ddeac767-ec13-418b-a317-5f018fede5ab" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Deleting offline snapshot ddeac767-ec13-418b-a317-5f018fede5ab of volume b5fc9117-58d6-4505-bdac-65711f0f79bc {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] snapshot_file for this snap is: volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95a91a8-9e26-4b09-839e-35c40a1ef390]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:31 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab Apr 15 10:11:31 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5c7fba48-b5cf-4258-9197-dddf055309bf tempest-VolumesActionsTest-753798396 None] Acquiring lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d-detach_volume" by "detach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5c7fba48-b5cf-4258-9197-dddf055309bf tempest-VolumesActionsTest-753798396 None] Lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5c7fba48-b5cf-4258-9197-dddf055309bf tempest-VolumesActionsTest-753798396 None] Detaching volume 655e5274-5f96-4d9d-8ff7-b79e82f2523d from instance 0c04fc00-7248-462f-8158-a6e5f10c44f5. Apr 15 10:11:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5c7fba48-b5cf-4258-9197-dddf055309bf tempest-VolumesActionsTest-753798396 None] Detach volume completed successfully. Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5c7fba48-b5cf-4258-9197-dddf055309bf tempest-VolumesActionsTest-753798396 None] Lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:31 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4" returned: 0 in 0.561s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:31 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae Apr 15 10:11:31 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:31 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab" returned: 0 in 0.580s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5fc9117-58d6-4505-bdac-65711f0f79bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf50a68-3fda-447c-bab9-cf5bfe51e180]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Flow 'volume_create_manager' (9ee90372-cd01-4e7d-8cdc-bd109f37a4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:31 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc Apr 15 10:11:31 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2dac95-5679-4509-9110-37560e54d3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2dac95-5679-4509-9110-37560e54d3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1973897026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860d3bac-5c16-414b-afbd-d76846853d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f352c3eae2d43f9a0c595122e267b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9f4b725f-4b41-4df3-8b0f-6be13eac30d6,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:32Z,use_quota=True,user_id='5fd89f74a8c64a23aea07328e17efa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f496186-18dd-47fa-947c-ecbee76fc22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f496186-18dd-47fa-947c-ecbee76fc22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e89697-5b82-423a-a497-e231f8524679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e89697-5b82-423a-a497-e231f8524679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '860d3bac-5c16-414b-afbd-d76846853d9a', 'volume_name': 'volume-860d3bac-5c16-414b-afbd-d76846853d9a', 'volume_size': 1, 'source_volid': '9f4b725f-4b41-4df3-8b0f-6be13eac30d6', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26052450-a370-436a-ae19-9993f14bc4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26052450-a370-436a-ae19-9993f14bc4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b58a57e-7b18-4c97-beb8-d6c1250405f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Volume 860d3bac-5c16-414b-afbd-d76846853d9a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-860d3bac-5c16-414b-afbd-d76846853d9a', 'volume_size': 1, 'source_volid': '9f4b725f-4b41-4df3-8b0f-6be13eac30d6', 'source_volstatus': 'available'} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:32 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Cloning volume 9f4b725f-4b41-4df3-8b0f-6be13eac30d6 to volume 860d3bac-5c16-414b-afbd-d76846853d9a Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Creating offline snapshot ddca2d53-5cc9-4366-86dd-b62756fd0c28 of volume 9f4b725f-4b41-4df3-8b0f-6be13eac30d6 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e280179-87c0-4c48-8040-d8ca925099e0]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:32 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae" returned: 0 in 0.558s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:32 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae Apr 15 10:11:32 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 Apr 15 10:11:32 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:32 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:32 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc" returned: 0 in 0.672s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:32 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab Apr 15 10:11:32 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:32 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4.eaef630d-5ef6-4ffd-8fdb-59c4c1214fae" returned: 0 in 0.508s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-eaef630d-5ef6-4ffd-8fdb-59c4c1214fae" released by "_delete_snapshot" :: held 2.269s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-f1092093-263c-4d2b-b807-84d2056874e4" released by "delete_snapshot" :: held 2.297s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:32 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6" returned: 0 in 0.680s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:32 devstack cinder-volume[83167]: WARNING cinder.quota [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1488933767 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1488933767, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:32 devstack cinder-volume[83167]: WARNING cinder.quota [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1488933767 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1488933767, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:32 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 1G Apr 15 10:11:32 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:32 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] Created reservations ['ef45851c-542b-4713-bbf5-be147061a292', '339caf5f-bb35-49a9-b4cf-03016175f384', '339976a3-ad9b-49d3-9125-bb30ae3ead12', 'c3f2cb3b-d165-469f-9c36-7dea10024210'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d07899c5-73ae-49a6-ac3b-c2ba54e3a2fb tempest-GroupSnapshotsTest-1684095675 None] group_snapshot 6ec1e907-0252-4732-aa71-71254257ae32: deleted successfully Apr 15 10:11:33 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab" returned: 0 in 0.520s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:33 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab Apr 15 10:11:33 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:33 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 1G" returned: 0 in 0.515s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:33 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 Apr 15 10:11:33 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:33 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc.ddeac767-ec13-418b-a317-5f018fede5ab" returned: 0 in 0.526s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-ddeac767-ec13-418b-a317-5f018fede5ab" released by "_delete_snapshot" :: held 2.355s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-b5fc9117-58d6-4505-bdac-65711f0f79bc" released by "delete_snapshot" :: held 2.365s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Created reservations ['69b6d451-aac5-4fad-8849-9b3326b82461', '4a823a6b-7d3c-42d8-8bd4-840335ad020c', 'f412151e-67e0-4ba3-bb2e-7acc4d2fcf25', '980e7f26-18d8-48ef-b760-986745a40790'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Delete snapshot completed successfully. Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-ddeac767-ec13-418b-a317-5f018fede5ab-delete_snapshot" released by "delete_snapshot" :: held 2.477s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Snapshots deleted, issuing volume delete {{(pid=83167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-quobyte-b5fc9117-58d6-4505-bdac-65711f0f79bc" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-b5fc9117-58d6-4505-bdac-65711f0f79bc" acquired by "delete_volume" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e11900-4371-4d97-ad93-bc6437fddedb]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:33 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc Apr 15 10:11:33 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:33 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "cinder-quobyte-f1092093-263c-4d2b-b807-84d2056874e4" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28" returned: 0 in 0.631s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:33 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 is being set with open permissions: ugo+rw Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-f1092093-263c-4d2b-b807-84d2056874e4" acquired by "delete_volume" :: waited 0.035s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:33 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 Apr 15 10:11:33 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1625fd2-e854-4443-9dc7-f3ea0fc3b585]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:34 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4 Apr 15 10:11:34 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:34 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:34 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28" returned: 0 in 0.477s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc" returned: 0 in 0.618s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:34 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc Apr 15 10:11:34 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:34 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4" returned: 0 in 0.492s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:34 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.info Apr 15 10:11:34 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:34 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4 Apr 15 10:11:34 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:34 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.info" returned: 0 in 0.436s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:34 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.info is being set with open permissions: ugo+rw Apr 15 10:11:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:34 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.info Apr 15 10:11:34 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:34 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5fc9117-58d6-4505-bdac-65711f0f79bc" returned: 0 in 0.512s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-b5fc9117-58d6-4505-bdac-65711f0f79bc" released by "delete_volume" :: held 1.194s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:35 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Created reservations ['14f08288-3cf1-49db-9b25-b0de342a3816', '6957f78b-7278-4ff8-8159-4e2f199a8242', '6684e9fc-1d31-4944-b8f9-644db65cc476', '7a5f6218-6c1a-43a2-a4e7-58a8eedf363d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f1092093-263c-4d2b-b807-84d2056874e4" returned: 0 in 0.615s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Lock "cinder-quobyte-f1092093-263c-4d2b-b807-84d2056874e4" released by "delete_volume" :: held 1.148s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Created reservations ['682ceab1-2b0d-4d9d-8581-8f0a0644bf53'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:35 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:11:35 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:35 devstack cinder-volume[83167]: WARNING cinder.quota [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1488933767 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1488933767, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Created reservations ['a4d5a626-0b2e-406e-8040-d796191a844d', '79d507dc-17a3-455a-9e38-68bffa83a0d8', 'aa5ebe6f-873d-424b-86ed-98f5ece1feea', 'd9566192-aec5-43f3-8bc6-290c96a51da4'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:35 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:11:35 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:35 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.info" returned: 0 in 0.684s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-quobyte-860d3bac-5c16-414b-afbd-d76846853d9a" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-860d3bac-5c16-414b-afbd-d76846853d9a" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] snapshot: ddca2d53-5cc9-4366-86dd-b62756fd0c28, volume: 860d3bac-5c16-414b-afbd-d76846853d9a, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f486a1f-23de-4290-8e94-ba4f35dfeee6]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:35 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 Apr 15 10:11:35 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:35 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.542s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:35 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Deleted volume successfully. Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36037b3f-7892-4e56-a4df-157b9218bede tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-b5fc9117-58d6-4505-bdac-65711f0f79bc-delete_volume" released by "delete_volume" :: held 9.313s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:35 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.421s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:35 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:35 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a68d0901-ec35-42ce-b5e2-513391bd6083 tempest-GroupSnapshotsTest-1684095675 None] Delete group completed successfully. Apr 15 10:11:36 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28" returned: 0 in 0.473s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] will copy from snapshot at /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a89bb86-5817-466c-8df9-acf1475695cc]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:36 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 Apr 15 10:11:36 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Flow 'volume_create_manager' (897dd573-5f75-402b-9377-00dd0e0cd2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10b3094-9720-4d00-bc9e-529661c65f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10b3094-9720-4d00-bc9e-529661c65f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-496342655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0ffc90-0d61-4fba-b8fa-c4b9dade204a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1739704bd6ff44e98482d686b5299ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:37Z,use_quota=True,user_id='c2ced848f7154cdeb7a04cb30e8f1afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a184763-ad3b-4cc8-883e-1a4c9b3f2bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a184763-ad3b-4cc8-883e-1a4c9b3f2bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c61e97-a55d-415c-b36d-add430ed2084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c61e97-a55d-415c-b36d-add430ed2084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab0ffc90-0d61-4fba-b8fa-c4b9dade204a', 'volume_name': 'volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a722955b-5a34-4393-b32a-ffc3ba8f20d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a722955b-5a34-4393-b32a-ffc3ba8f20d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9478f1a0-9d91-405c-9f01-350156f5d575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:36 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Volume ab0ffc90-0d61-4fba-b8fa-c4b9dade204a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a', 'volume_size': 1} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:36 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6" returned: 0 in 0.633s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Path /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:11:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:36 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a Apr 15 10:11:36 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:37 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:11:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:37 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:11:37 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:39 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.395s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:39 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:39 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a" returned: 0 in 2.532s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:39 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a981d1c-1aa3-4cf0-a8f5-f8cebd29612a]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:39 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 Apr 15 10:11:39 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:39 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6" returned: 0 in 0.661s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:39 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:11:39 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Converted 1024.00 MB image at 404.25 MB/s Apr 15 10:11:39 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a is being set with open permissions: ugo+rw Apr 15 10:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:39 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a Apr 15 10:11:39 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:40 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a" returned: 0 in 0.477s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-860d3bac-5c16-414b-afbd-d76846853d9a" released by "_copy_volume_from_snapshot" :: held 4.821s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-quobyte-ddca2d53-5cc9-4366-86dd-b62756fd0c28" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-ddca2d53-5cc9-4366-86dd-b62756fd0c28" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Deleting offline snapshot ddca2d53-5cc9-4366-86dd-b62756fd0c28 of volume 9f4b725f-4b41-4df3-8b0f-6be13eac30d6 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] snapshot_file for this snap is: volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:40 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[763a92d9-7598-40ed-9505-630d825b0e1d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:40 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 Apr 15 10:11:40 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:41 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28" returned: 0 in 0.576s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:41 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[86da7244-213e-4743-ae0f-0eb1e7f3e383]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:41 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 Apr 15 10:11:41 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:41 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6" returned: 0 in 0.544s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:41 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 Apr 15 10:11:41 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:42 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28" returned: 0 in 0.519s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:42 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28 Apr 15 10:11:42 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:42 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6.ddca2d53-5cc9-4366-86dd-b62756fd0c28" returned: 0 in 0.433s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-ddca2d53-5cc9-4366-86dd-b62756fd0c28" released by "_delete_snapshot" :: held 2.137s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.523s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.907s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-496342655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0ffc90-0d61-4fba-b8fa-c4b9dade204a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1739704bd6ff44e98482d686b5299ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:37Z,use_quota=True,user_id='c2ced848f7154cdeb7a04cb30e8f1afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Creating volume ab0ffc90-0d61-4fba-b8fa-c4b9dade204a {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:42 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b58a57e-7b18-4c97-beb8-d6c1250405f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-860d3bac-5c16-414b-afbd-d76846853d9a', 'volume_size': 1, 'source_volid': '9f4b725f-4b41-4df3-8b0f-6be13eac30d6', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:42 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a 1073741824 Apr 15 10:11:42 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252bbfdb-a2e6-4949-a01d-fb07c396b4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:42 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Volume volume-860d3bac-5c16-414b-afbd-d76846853d9a (860d3bac-5c16-414b-afbd-d76846853d9a): created successfully Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252bbfdb-a2e6-4949-a01d-fb07c396b4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Flow 'volume_create_manager' (9ee90372-cd01-4e7d-8cdc-bd109f37a4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:42 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b789325c-e3f8-4bb8-be1b-55d60553c5b5 tempest-VolumeDependencyTests-304943600 None] Created volume successfully. Apr 15 10:11:43 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a 1073741824" returned: 0 in 0.570s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:43 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a Apr 15 10:11:43 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:43 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a" returned: 0 in 0.420s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.503s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9478f1a0-9d91-405c-9f01-350156f5d575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e4e40b-cb0a-44fc-9703-bf40c48d37d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89186de-6316-475d-989f-8c808e3237e9]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:43 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Volume volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a (ab0ffc90-0d61-4fba-b8fa-c4b9dade204a): created successfully Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e4e40b-cb0a-44fc-9703-bf40c48d37d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Flow 'volume_create_manager' (897dd573-5f75-402b-9377-00dd0e0cd2f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:43 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-07c69750-b069-4c6f-9a2e-fd7c73841fd4 tempest-VolumesDeleteCascade-1438081154 None] Created volume successfully. Apr 15 10:11:43 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d Apr 15 10:11:43 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-9f4b725f-4b41-4df3-8b0f-6be13eac30d6-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-9f4b725f-4b41-4df3-8b0f-6be13eac30d6-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-quobyte-9f4b725f-4b41-4df3-8b0f-6be13eac30d6" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-9f4b725f-4b41-4df3-8b0f-6be13eac30d6" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f46ce62-2cba-47df-9dbc-675aef78acb0]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:43 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 Apr 15 10:11:43 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Flow 'volume_create_manager' (00b19829-3a80-4791-8668-a401a792c747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292d7df5-9dd8-4a92-bec0-103157e551cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292d7df5-9dd8-4a92-bec0-103157e551cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1703669260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5b3090-f6f6-446d-830b-4af6fae58997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cc6853bdb24aabb79ad138756c1d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:44Z,use_quota=True,user_id='f09bf27a856448baae0480fc6672f202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3cd93b-ae78-498e-9334-12445bc0d9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3cd93b-ae78-498e-9334-12445bc0d9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79c3d4a-6bf6-469e-9a38-164b16b644ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79c3d4a-6bf6-469e-9a38-164b16b644ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b5b3090-f6f6-446d-830b-4af6fae58997', 'volume_name': 'volume-7b5b3090-f6f6-446d-830b-4af6fae58997', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b95ecc1-4cdb-4887-849a-22d200cdfcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b95ecc1-4cdb-4887-849a-22d200cdfcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a360f5-00ed-48bb-91bf-3d612389ad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Volume 7b5b3090-f6f6-446d-830b-4af6fae58997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b5b3090-f6f6-446d-830b-4af6fae58997', 'volume_size': 1} Apr 15 10:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:44 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d" returned: 0 in 0.543s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[df90d802-5b26-4f38-b2dd-52f1a5aea77b]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:44 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:44 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:44 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6" returned: 0 in 0.507s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:44 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6 Apr 15 10:11:44 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:44 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d" returned: 0 in 0.499s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.979400a1-8dc4-479f-96b6-cb085584a0benaiij_cg.img {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:44 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.979400a1-8dc4-479f-96b6-cb085584a0benaiij_cg.img Apr 15 10:11:44 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:44 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9f4b725f-4b41-4df3-8b0f-6be13eac30d6" returned: 0 in 0.411s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-9f4b725f-4b41-4df3-8b0f-6be13eac30d6" released by "delete_volume" :: held 0.946s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Created reservations ['5ea91840-0072-4f93-aab0-cc9799ff81ef', '0e2cd092-8c28-4a08-980e-f5d765ea4e94', '38ca9c5e-7840-40e3-a593-e9949d049043', 'e48411f8-a436-4e2c-8695-b8326ccffa53'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-860d3bac-5c16-414b-afbd-d76846853d9a-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Lock "cinder-860d3bac-5c16-414b-afbd-d76846853d9a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:44 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:11:44 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-quobyte-860d3bac-5c16-414b-afbd-d76846853d9a" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-860d3bac-5c16-414b-afbd-d76846853d9a" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aef7602-4fe4-4e83-9658-5ea719179c7d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:44 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a Apr 15 10:11:44 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:45 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.710s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:45 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:45 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Deleted volume successfully. Apr 15 10:11:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-128768a3-b992-4f9a-9968-f7aa7c8a0cd0 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-9f4b725f-4b41-4df3-8b0f-6be13eac30d6-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:45 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a" returned: 0 in 0.991s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:45 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a Apr 15 10:11:45 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:46 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-860d3bac-5c16-414b-afbd-d76846853d9a" returned: 0 in 0.790s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-860d3bac-5c16-414b-afbd-d76846853d9a" released by "delete_volume" :: held 1.802s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:46 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.979400a1-8dc4-479f-96b6-cb085584a0benaiij_cg.img" returned: 0 in 2.075s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:46 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Created reservations ['a9925142-8da5-43e9-bb34-35637ce8d040', '439ef37d-c115-469e-9a6b-c6be7ae05f3a', '7e3a38e9-9869-4cb9-ae89-8227888884c3', '0ab53782-0390-4df8-8c38-ac6c784bc224'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:46 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed26d6e-0e7d-4c5a-80ad-582c2bdfc38b]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:46 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d Apr 15 10:11:46 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:46 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:11:46 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-73975f01-fc88-497b-9450-283aec229a80-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-73975f01-fc88-497b-9450-283aec229a80-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "cinder-quobyte-73975f01-fc88-497b-9450-283aec229a80" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-73975f01-fc88-497b-9450-283aec229a80" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b171d0-5102-4401-8ce4-207d29be2879]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:47 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.465s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:47 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Deleted volume successfully. Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b498e90-25c7-4430-a705-4780d159508c tempest-VolumeDependencyTests-304943600 None] Lock "cinder-860d3bac-5c16-414b-afbd-d76846853d9a-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:47 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80 Apr 15 10:11:47 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:47 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d" returned: 0 in 0.629s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.979400a1-8dc4-479f-96b6-cb085584a0benaiij_cg.img {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:11:47 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] Converted 1024.00 MB image at 493.19 MB/s Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] 979400a1-8dc4-479f-96b6-cb085584a0be was raw, no need to convert to raw {{(pid=83167) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 15 10:11:47 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80" returned: 0 in 0.561s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:47 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80 Apr 15 10:11:47 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:48 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-73975f01-fc88-497b-9450-283aec229a80" returned: 0 in 0.473s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-quobyte-73975f01-fc88-497b-9450-283aec229a80" released by "delete_volume" :: held 1.060s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:48 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Created reservations ['e53ab29d-042e-4b2c-82da-cdb0baa434b9', '6f638f09-d0b9-430c-8fff-9bf66dece502', 'c1c40359-c14c-4a4a-b5f0-ec2e38a6a037', 'e83a1922-a930-4772-93d7-ba6e4b35183d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:48 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:11:48 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:48 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.490s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:48 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Deleted volume successfully. Apr 15 10:11:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-423e5393-37f5-4edf-a16e-90fb399e61e6 tempest-VolumeDependencyTests-304943600 None] Lock "cinder-73975f01-fc88-497b-9450-283aec229a80-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.715s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] Uploaded volume to glance image-id: 979400a1-8dc4-479f-96b6-cb085584a0be. {{(pid=83167) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.389s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1703669260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5b3090-f6f6-446d-830b-4af6fae58997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cc6853bdb24aabb79ad138756c1d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:44Z,use_quota=True,user_id='f09bf27a856448baae0480fc6672f202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Creating volume 7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:57 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:57 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997 1073741824 Apr 15 10:11:57 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b09806e8-874b-452e-baec-2ba12292577c tempest-VolumesActionsTest-753798396 None] Copy volume to image completed successfully. Apr 15 10:11:57 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997 1073741824" returned: 0 in 0.546s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:57 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997 Apr 15 10:11:57 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:58 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997" returned: 0 in 0.474s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.112s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] Creating offline snapshot 57c34c77-784e-4903-86e1-6d6c44b4a920 of volume ab0ffc90-0d61-4fba-b8fa-c4b9dade204a {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a360f5-00ed-48bb-91bf-3d612389ad47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b5b3090-f6f6-446d-830b-4af6fae58997', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b492fc3-eb39-4ab3-9bd6-e612e6baf034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87c33b9-683a-4e58-aea2-20f72a101f41]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:58 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Volume volume-7b5b3090-f6f6-446d-830b-4af6fae58997 (7b5b3090-f6f6-446d-830b-4af6fae58997): created successfully Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b492fc3-eb39-4ab3-9bd6-e612e6baf034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Flow 'volume_create_manager' (00b19829-3a80-4791-8668-a401a792c747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:58 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-89cce43a-9121-422b-a95f-576559c82a05 tempest-SnapshotsActionsTest-1847403320 None] Created volume successfully. Apr 15 10:11:58 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a Apr 15 10:11:58 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:58 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a" returned: 0 in 0.521s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:58 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 1G Apr 15 10:11:58 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:59 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 1G" returned: 0 in 0.485s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:59 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 Apr 15 10:11:59 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:59 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920" returned: 0 in 0.445s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:59 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 is being set with open permissions: ugo+rw Apr 15 10:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:59 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 Apr 15 10:11:59 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:00 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920" returned: 0 in 0.404s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:00 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.info Apr 15 10:12:00 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:00 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.info" returned: 0 in 0.442s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:00 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.info is being set with open permissions: ugo+rw Apr 15 10:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:00 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.info Apr 15 10:12:00 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:01 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.info" returned: 0 in 0.413s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.799s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.936s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[67351a33-06e1-4f55-addc-ea8028f50cff]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2504859e-4f4d-4149-a991-4a83f6b675a3 tempest-VolumesDeleteCascade-1438081154 None] Create snapshot completed successfully Apr 15 10:12:01 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d Apr 15 10:12:01 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:01 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d" returned: 0 in 0.523s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[65056103-9301-4c5f-ade7-98a28666fac5]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:01 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d Apr 15 10:12:01 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Flow 'volume_create_manager' (e18de267-7e2e-4480-add4-51913bf0b713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acedfcf-5302-4980-98c0-50db93b10cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acedfcf-5302-4980-98c0-50db93b10cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-349321777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f365cb-7a1e-41b6-8683-5b69038cf74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1739704bd6ff44e98482d686b5299ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=57c34c77-784e-4903-86e1-6d6c44b4a920,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:02Z,use_quota=True,user_id='c2ced848f7154cdeb7a04cb30e8f1afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b050c9-6f3b-4b28-8678-c8f3ea0897f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b050c9-6f3b-4b28-8678-c8f3ea0897f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b627678b-947a-4586-b548-40571ef93000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b627678b-947a-4586-b548-40571ef93000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '61f365cb-7a1e-41b6-8683-5b69038cf74c', 'volume_name': 'volume-61f365cb-7a1e-41b6-8683-5b69038cf74c', 'volume_size': 1, 'snapshot_id': '57c34c77-784e-4903-86e1-6d6c44b4a920'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07224ae-092c-4b20-b678-a7a8c29c45e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07224ae-092c-4b20-b678-a7a8c29c45e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3719642c-72a9-43f8-8a25-f8440d60359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:02 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Volume 61f365cb-7a1e-41b6-8683-5b69038cf74c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-61f365cb-7a1e-41b6-8683-5b69038cf74c', 'volume_size': 1, 'snapshot_id': '57c34c77-784e-4903-86e1-6d6c44b4a920'} Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:02 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d" returned: 0 in 0.526s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:02 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img Apr 15 10:12:02 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:04 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img" returned: 0 in 1.886s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2efd4f-fa09-4931-9c27-92457bb62087]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:04 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d Apr 15 10:12:04 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:04 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d" returned: 0 in 0.568s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:04 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d, size 1024.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:12:04 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Converted 1024.00 MB image at 542.49 MB/s Apr 15 10:12:04 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=170,cinder:SELECT=151,cinder:INSERT=41,cinder:DELETE=13 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:12:04 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=171,cinder:SELECT=175,cinder:INSERT=48,cinder:DELETE=6 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:12:04 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] ba6c64ce-6265-4157-8299-fedeca75b987 was raw, converting to qcow2 {{(pid=83167) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 15 10:12:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7892c967-8adc-467d-8a81-ea1fecd05795]: (4, 'raw') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:04 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img Apr 15 10:12:04 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:05 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img" returned: 0 in 0.439s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:05 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img Apr 15 10:12:05 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:05 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img" returned: 1 in 0.443s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img /opt/stack/data/cinder/conversion/vol_upload_at1l95wb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:05 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img /opt/stack/data/cinder/conversion/vol_upload_at1l95wb Apr 15 10:12:05 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:06 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img /opt/stack/data/cinder/conversion/vol_upload_at1l95wb" returned: 0 in 0.417s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:06 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Image conversion details: src /opt/stack/data/cinder/conversion/655e5274-5f96-4d9d-8ff7-b79e82f2523d.temp_image.ba6c64ce-6265-4157-8299-fedeca75b987r3dr3igi.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_at1l95wb {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:12:06 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 15 10:12:06 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bd0041-2981-4167-910d-e0831eca8e39]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_at1l95wb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:06 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_at1l95wb Apr 15 10:12:06 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:06 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_at1l95wb" returned: 0 in 0.452s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.135s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Uploaded volume to glance image-id: ba6c64ce-6265-4157-8299-fedeca75b987. {{(pid=83167) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.499s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-92d1a6ff-b8c6-4879-9300-926700b0be7c tempest-VolumesActionsTest-753798396 None] Copy volume to image completed successfully. Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] Creating offline snapshot 8c346aac-a617-42fb-811b-8015c9a8c828 of volume 7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[215e85fd-be3c-4e66-83ec-ae33cdd921c3]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:07 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997 Apr 15 10:12:07 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:07 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997" returned: 0 in 0.515s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Acquiring lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:07 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 1G Apr 15 10:12:07 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Acquiring lock "cinder-quobyte-655e5274-5f96-4d9d-8ff7-b79e82f2523d" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Lock "cinder-quobyte-655e5274-5f96-4d9d-8ff7-b79e82f2523d" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[72342d0b-d62c-4700-aeac-f7f4c03f9827]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:07 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d Apr 15 10:12:07 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:08 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 1G" returned: 0 in 0.470s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:08 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 Apr 15 10:12:08 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:08 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d" returned: 0 in 0.494s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:08 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d Apr 15 10:12:08 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:08 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828" returned: 0 in 0.417s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:08 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 is being set with open permissions: ugo+rw Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:08 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 Apr 15 10:12:08 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:08 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-655e5274-5f96-4d9d-8ff7-b79e82f2523d" returned: 0 in 0.408s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Lock "cinder-quobyte-655e5274-5f96-4d9d-8ff7-b79e82f2523d" released by "delete_volume" :: held 0.922s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Created reservations ['6e0864a6-8eb4-4543-9d1d-f0ca57b5e4ae', '29cf484c-a60f-4f92-8a45-2d4c9fe77142', '5663fa0f-16a3-493a-b1e1-f173cdf786ef', 'ffa5d020-6906-45e9-8140-f2766caa8fcc'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:08 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:08 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:09 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828" returned: 0 in 0.471s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:09 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.info Apr 15 10:12:09 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:09 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.422s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:09 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Deleted volume successfully. Apr 15 10:12:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d15308d-d672-45c2-9afe-bdc7753a3ba9 tempest-VolumesActionsTest-753798396 None] Lock "cinder-655e5274-5f96-4d9d-8ff7-b79e82f2523d-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:09 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.info" returned: 0 in 0.460s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:09 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.info is being set with open permissions: ugo+rw Apr 15 10:12:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:09 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.info Apr 15 10:12:09 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:10 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.info" returned: 0 in 0.441s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.829s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.040s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-quobyte-57c34c77-784e-4903-86e1-6d6c44b4a920-61f365cb-7a1e-41b6-8683-5b69038cf74c" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:10 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ca69fd44-dfb7-4587-b971-2098272243df tempest-SnapshotsActionsTest-1847403320 None] Create snapshot completed successfully Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-57c34c77-784e-4903-86e1-6d6c44b4a920-61f365cb-7a1e-41b6-8683-5b69038cf74c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Creating volume 61f365cb-7a1e-41b6-8683-5b69038cf74c from snapshot 57c34c77-784e-4903-86e1-6d6c44b4a920 {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-quobyte-61f365cb-7a1e-41b6-8683-5b69038cf74c" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-61f365cb-7a1e-41b6-8683-5b69038cf74c" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] snapshot: 57c34c77-784e-4903-86e1-6d6c44b4a920, volume: 61f365cb-7a1e-41b6-8683-5b69038cf74c, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[273d8da4-4210-4496-8922-37f290594059]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:10 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 Apr 15 10:12:10 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:10 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920" returned: 0 in 0.497s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] will copy from snapshot at /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6797508-a3af-4d5f-bb72-9f978897e778]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:10 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a Apr 15 10:12:10 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:11 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a" returned: 0 in 0.589s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:11 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Path /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:12:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:11 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c Apr 15 10:12:11 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:13 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c" returned: 0 in 2.121s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:13 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97d8d98-14fd-435b-a8ae-00e3c890e1e8]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:13 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a Apr 15 10:12:13 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:14 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Flow 'volume_create_manager' (23350b79-1a2e-4c2b-9b53-7101b6810230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591b4471-c110-471e-b546-2e3872ffa763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a" returned: 0 in 0.660s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:12:14 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Converted 1024.00 MB image at 482.48 MB/s Apr 15 10:12:14 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c is being set with open permissions: ugo+rw Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591b4471-c110-471e-b546-2e3872ffa763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-815518153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aaecaae-02d9-4cdf-96a6-736bfc8225c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01aa6c0882de41e485447bf4d3e6c184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:14Z,use_quota=True,user_id='d6ad8724c81a4fb48a81a4fec3f9876f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:14 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c Apr 15 10:12:14 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8ad959-aa5e-463f-b974-2b9df8613d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8ad959-aa5e-463f-b974-2b9df8613d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030c3aaf-eaba-42d0-a657-81a314b3bf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030c3aaf-eaba-42d0-a657-81a314b3bf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aaecaae-02d9-4cdf-96a6-736bfc8225c8', 'volume_name': 'volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8', 'volume_size': 2}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa43fb8-a814-4f53-86e3-15b71c04b217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa43fb8-a814-4f53-86e3-15b71c04b217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e8c065-202a-463e-ba04-43fab2b746cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:14 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Volume 1aaecaae-02d9-4cdf-96a6-736bfc8225c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8', 'volume_size': 2} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:14 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c" returned: 0 in 0.392s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-61f365cb-7a1e-41b6-8683-5b69038cf74c" released by "_copy_volume_from_snapshot" :: held 4.313s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-57c34c77-784e-4903-86e1-6d6c44b4a920-61f365cb-7a1e-41b6-8683-5b69038cf74c" released by "_create_volume_from_snapshot" :: held 4.332s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.350s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.780s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] Creating offline snapshot 64f30974-5b8c-444c-a773-9d40b4a46196 of volume 7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3719642c-72a9-43f8-8a25-f8440d60359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f365cb-7a1e-41b6-8683-5b69038cf74c', 'volume_size': 1, 'snapshot_id': '57c34c77-784e-4903-86e1-6d6c44b4a920'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e83fcd-ac93-48a8-bca8-137d5c58386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4453c52f-8ed5-43d8-a122-10811e932b26]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:14 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Volume volume-61f365cb-7a1e-41b6-8683-5b69038cf74c (61f365cb-7a1e-41b6-8683-5b69038cf74c): created successfully Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e83fcd-ac93-48a8-bca8-137d5c58386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Flow 'volume_create_manager' (e18de267-7e2e-4480-add4-51913bf0b713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a99b85eb-5e3d-43ac-bc09-57779f904b52 tempest-VolumesDeleteCascade-1438081154 None] Created volume successfully. Apr 15 10:12:14 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 Apr 15 10:12:14 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Performing cascade delete. {{(pid=83167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-57c34c77-784e-4903-86e1-6d6c44b4a920-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-57c34c77-784e-4903-86e1-6d6c44b4a920-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-quobyte-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-quobyte-57c34c77-784e-4903-86e1-6d6c44b4a920" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-57c34c77-784e-4903-86e1-6d6c44b4a920" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Deleting offline snapshot 57c34c77-784e-4903-86e1-6d6c44b4a920 of volume ab0ffc90-0d61-4fba-b8fa-c4b9dade204a {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] snapshot_file for this snap is: volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[238bb020-1e13-4404-8139-15b61f934f6e]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:15 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 Apr 15 10:12:15 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:15 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828" returned: 0 in 0.501s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5b3090-f6f6-446d-830b-4af6fae58997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:15 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 1G Apr 15 10:12:15 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:15 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920" returned: 0 in 0.474s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[35025647-ee93-44df-90d6-2da47b2091cc]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:15 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a Apr 15 10:12:15 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:15 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 1G" returned: 0 in 0.501s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:15 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 Apr 15 10:12:15 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:15 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a" returned: 0 in 0.535s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:16 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 Apr 15 10:12:16 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:16 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196" returned: 0 in 0.439s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:16 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 is being set with open permissions: ugo+rw Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:16 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 Apr 15 10:12:16 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:16 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196" returned: 0 in 0.410s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:16 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.287s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-815518153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aaecaae-02d9-4cdf-96a6-736bfc8225c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01aa6c0882de41e485447bf4d3e6c184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:14Z,use_quota=True,user_id='d6ad8724c81a4fb48a81a4fec3f9876f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Creating volume 1aaecaae-02d9-4cdf-96a6-736bfc8225c8 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:16 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8 2147483648 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920" returned: 0 in 0.480s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:16 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8 2147483648 Apr 15 10:12:16 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1143127d-3c27-4083-93ba-c973c2fea463 tempest-SnapshotsActionsTest-1847403320 None] Create snapshot completed successfully Apr 15 10:12:16 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920 Apr 15 10:12:16 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:16 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a.57c34c77-784e-4903-86e1-6d6c44b4a920" returned: 0 in 0.433s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-57c34c77-784e-4903-86e1-6d6c44b4a920" released by "_delete_snapshot" :: held 1.967s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a" released by "delete_snapshot" :: held 1.980s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Created reservations ['675b43b8-5f3d-4eb5-9ebe-2cbc9bcc3ffa', '152b7ee4-f9a8-473c-b6b1-d36200cb211b', 'b8a9e0b6-48fc-48ae-86be-979f4f1309b7', '35919f0f-cbe2-48f3-b8ee-28547f05658c'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:16 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8 2147483648" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Delete snapshot completed successfully. Apr 15 10:12:17 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8 Apr 15 10:12:17 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Acquiring lock "cinder-64f30974-5b8c-444c-a773-9d40b4a46196-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-57c34c77-784e-4903-86e1-6d6c44b4a920-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Snapshots deleted, issuing volume delete {{(pid=83167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-quobyte-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-64f30974-5b8c-444c-a773-9d40b4a46196-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Acquiring lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Acquiring lock "cinder-quobyte-64f30974-5b8c-444c-a773-9d40b4a46196" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[464b870c-eba3-47ed-b92a-a54c59118e0e]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-64f30974-5b8c-444c-a773-9d40b4a46196" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Deleting offline snapshot 64f30974-5b8c-444c-a773-9d40b4a46196 of volume 7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] snapshot_file for this snap is: volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f233f4e-c5fa-41ea-bd69-a0bb01827d0c]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:17 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a Apr 15 10:12:17 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:17 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 Apr 15 10:12:17 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:17 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8" returned: 0 in 0.455s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e8c065-202a-463e-ba04-43fab2b746cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8', 'volume_size': 2}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca64d1f-61af-446a-9bb8-570304c7f29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:17 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Volume volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8 (1aaecaae-02d9-4cdf-96a6-736bfc8225c8): created successfully Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca64d1f-61af-446a-9bb8-570304c7f29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Flow 'volume_create_manager' (23350b79-1a2e-4c2b-9b53-7101b6810230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f9cd53eb-ef81-44e3-9a63-c7a33f09517b tempest-VolumesCloneNegativeTest-361433827 None] Created volume successfully. Apr 15 10:12:17 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a" returned: 0 in 0.503s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:17 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196" returned: 0 in 0.483s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5b3090-f6f6-446d-830b-4af6fae58997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:17 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a Apr 15 10:12:17 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[23272c47-9185-4acc-acd9-772b6012b7b1]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:17 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 Apr 15 10:12:17 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:17 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a" returned: 0 in 0.389s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a" released by "delete_volume" :: held 0.923s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Created reservations ['5fe3a582-1b10-47bd-be37-db39b6aeebd2', '5fd05f5f-3309-40db-a505-7dd62b1e2086', '659e76c8-24dd-4678-8b22-ffa24eaa8c13', 'aba5eb1e-7b74-4908-af56-2bfbe8a581cb'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:18 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:18 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:18 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828" returned: 0 in 0.502s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5b3090-f6f6-446d-830b-4af6fae58997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:18 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 Apr 15 10:12:18 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-61f365cb-7a1e-41b6-8683-5b69038cf74c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-61f365cb-7a1e-41b6-8683-5b69038cf74c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "cinder-quobyte-61f365cb-7a1e-41b6-8683-5b69038cf74c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-61f365cb-7a1e-41b6-8683-5b69038cf74c" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc77cf2-f7a1-4fb0-8d84-6ffcb2eac962]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:18 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c Apr 15 10:12:18 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Acquiring lock "cinder-1aaecaae-02d9-4cdf-96a6-736bfc8225c8-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Lock "cinder-1aaecaae-02d9-4cdf-96a6-736bfc8225c8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Acquiring lock "cinder-quobyte-1aaecaae-02d9-4cdf-96a6-736bfc8225c8" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Lock "cinder-quobyte-1aaecaae-02d9-4cdf-96a6-736bfc8225c8" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4a40a0-9ac5-47eb-b239-912170d35cd7]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:18 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8 Apr 15 10:12:18 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:18 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.549s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Deleted volume successfully. Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a457071-2147-4ecc-a71c-cf0f1dc8f51c tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-ab0ffc90-0d61-4fba-b8fa-c4b9dade204a-delete_volume" released by "delete_volume" :: held 3.784s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:18 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196" returned: 0 in 0.560s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:18 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196 Apr 15 10:12:18 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:18 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c" returned: 0 in 0.536s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:18 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c Apr 15 10:12:18 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:19 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8" returned: 0 in 0.532s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:19 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8 Apr 15 10:12:19 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:19 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.64f30974-5b8c-444c-a773-9d40b4a46196" returned: 0 in 0.413s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-64f30974-5b8c-444c-a773-9d40b4a46196" released by "_delete_snapshot" :: held 2.010s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" released by "delete_snapshot" :: held 2.036s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Created reservations ['7dd13b74-8290-48ce-abbd-339b5c63ff91', '10580d6c-43e3-4355-b61b-38f2f36022a3', '174f768e-3b64-4c8c-b987-223523646dfc', '3e8ac871-cd3e-43aa-be13-99c7936a6ba6'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Delete snapshot completed successfully. Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-639abd9e-0355-49db-9bd7-f857633f61a6 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-64f30974-5b8c-444c-a773-9d40b4a46196-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:19 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-61f365cb-7a1e-41b6-8683-5b69038cf74c" returned: 0 in 0.432s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-quobyte-61f365cb-7a1e-41b6-8683-5b69038cf74c" released by "delete_volume" :: held 0.989s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Created reservations ['7873fb1d-ef39-4253-a2fd-9d8950b985e7', '3742243e-739c-491d-a4cf-bb3f070f6041', '69a76d55-b397-4cb2-9c65-fb4e86516baa', 'a75fe64b-318a-4909-b194-511a116024b2'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:19 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:19 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:19 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-1aaecaae-02d9-4cdf-96a6-736bfc8225c8" returned: 0 in 0.455s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Lock "cinder-quobyte-1aaecaae-02d9-4cdf-96a6-736bfc8225c8" released by "delete_volume" :: held 1.018s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Created reservations ['8dc5f166-2b16-4952-a0aa-3a383f3e9b7a', '2b2c5afc-89c5-41c8-b3fb-d3ee4cdbb88f', '9b5c6d2f-8dbf-4022-b8a1-02ed61f76fbe', '6b434ba5-489a-481a-9307-8c0a43b20d23'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:19 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:19 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:19 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.413s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Deleted volume successfully. Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ddee9abc-a5b0-4a55-ba64-400d81e5768f tempest-VolumesDeleteCascade-1438081154 None] Lock "cinder-61f365cb-7a1e-41b6-8683-5b69038cf74c-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:19 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.394s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Deleted volume successfully. Apr 15 10:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e3ae4a11-6274-4d1d-aa09-07a18c29dd0d tempest-VolumesCloneNegativeTest-361433827 None] Lock "cinder-1aaecaae-02d9-4cdf-96a6-736bfc8225c8-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] Creating offline snapshot 68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 of volume 7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:20 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01f2f04-62ed-4294-ace3-6f09032c51d1]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:20 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 Apr 15 10:12:20 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:21 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828" returned: 0 in 0.591s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5b3090-f6f6-446d-830b-4af6fae58997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:21 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 1G Apr 15 10:12:21 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:21 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 1G" returned: 0 in 0.637s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:21 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 Apr 15 10:12:21 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:22 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3" returned: 0 in 0.531s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:22 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 is being set with open permissions: ugo+rw Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:22 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 Apr 15 10:12:22 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Flow 'volume_create_manager' (bfb9e680-fa93-4fc1-9649-ab51fe4616ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c61788-1b68-417c-97e7-f59b2a2bbb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c61788-1b68-417c-97e7-f59b2a2bbb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1788794498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780f8e35-6b94-4347-83a3-518d347cd995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e894c6b593645b58428a25c4869d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:22Z,use_quota=True,user_id='9838c7bf718e4a2d8f89efc833af6f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42695315-a696-4ef7-a43d-e0d716924756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42695315-a696-4ef7-a43d-e0d716924756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f9daae-bede-4204-b1ec-e3aaa48249af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f9daae-bede-4204-b1ec-e3aaa48249af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '780f8e35-6b94-4347-83a3-518d347cd995', 'volume_name': 'volume-780f8e35-6b94-4347-83a3-518d347cd995', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e19fdf8-e9f2-48c2-8d35-135bb3d35b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e19fdf8-e9f2-48c2-8d35-135bb3d35b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50eb1b1-7369-4fde-9495-9336aef8a0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Volume 780f8e35-6b94-4347-83a3-518d347cd995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-780f8e35-6b94-4347-83a3-518d347cd995', 'volume_size': 1} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Flow 'volume_create_manager' (6ecc9a7e-2544-476a-96f1-2dcfcd4b2c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7932db24-8e5b-4eea-9959-10d94348db9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7932db24-8e5b-4eea-9959-10d94348db9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1921667862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f4d7e0-5850-463c-8968-d001eb6daf2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eee94fb3ab047e0a83e54cd02d3c36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:23Z,use_quota=True,user_id='1a9ed2c7f548491294456cb4fdd871c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0a1e2c-d390-4970-ae75-1ea36587b2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0a1e2c-d390-4970-ae75-1ea36587b2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904fbc9e-881e-4337-90aa-a9e00e43a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904fbc9e-881e-4337-90aa-a9e00e43a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f4d7e0-5850-463c-8968-d001eb6daf2f', 'volume_name': 'volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f', 'volume_size': 2}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568f2f60-3e6e-47be-a806-f5c7b78270a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568f2f60-3e6e-47be-a806-f5c7b78270a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b622530-7ea9-4d07-b994-c1931a9c60ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Volume e6f4d7e0-5850-463c-8968-d001eb6daf2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f', 'volume_size': 2} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:22 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3" returned: 0 in 0.449s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.236s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1788794498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780f8e35-6b94-4347-83a3-518d347cd995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e894c6b593645b58428a25c4869d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:22Z,use_quota=True,user_id='9838c7bf718e4a2d8f89efc833af6f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Creating volume 780f8e35-6b94-4347-83a3-518d347cd995 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:22 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-780f8e35-6b94-4347-83a3-518d347cd995 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:22 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-780f8e35-6b94-4347-83a3-518d347cd995 1073741824 Apr 15 10:12:22 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-23cefa78-54b9-4554-8f3a-d2dab67bc92b tempest-SnapshotsActionsTest-1847403320 None] Create snapshot completed successfully Apr 15 10:12:23 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-780f8e35-6b94-4347-83a3-518d347cd995 1073741824" returned: 0 in 0.469s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-780f8e35-6b94-4347-83a3-518d347cd995 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:23 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-780f8e35-6b94-4347-83a3-518d347cd995 Apr 15 10:12:23 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Acquiring lock "cinder-68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Acquiring lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:23 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-780f8e35-6b94-4347-83a3-518d347cd995" returned: 0 in 0.424s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Acquiring lock "cinder-quobyte-68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.996s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1921667862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f4d7e0-5850-463c-8968-d001eb6daf2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eee94fb3ab047e0a83e54cd02d3c36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:23Z,use_quota=True,user_id='1a9ed2c7f548491294456cb4fdd871c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Creating volume e6f4d7e0-5850-463c-8968-d001eb6daf2f {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:23 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f 2147483648 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:23 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f 2147483648 Apr 15 10:12:23 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50eb1b1-7369-4fde-9495-9336aef8a0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780f8e35-6b94-4347-83a3-518d347cd995', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180ba1f3-ca7c-4626-8f01-36904ba2722c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Deleting offline snapshot 68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 of volume 7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] snapshot_file for this snap is: volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:23 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Volume volume-780f8e35-6b94-4347-83a3-518d347cd995 (780f8e35-6b94-4347-83a3-518d347cd995): created successfully Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180ba1f3-ca7c-4626-8f01-36904ba2722c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Flow 'volume_create_manager' (bfb9e680-fa93-4fc1-9649-ab51fe4616ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b094c8-9cc5-4b87-8593-daf40071c700]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-640fc508-2de2-4443-a2d6-eedb41c626f9 tempest-VolumesMetadataTest-944388767 None] Created volume successfully. Apr 15 10:12:23 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 Apr 15 10:12:23 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:24 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f 2147483648" returned: 0 in 0.506s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:24 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3" returned: 0 in 0.480s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5b3090-f6f6-446d-830b-4af6fae58997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:24 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f Apr 15 10:12:24 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaab8019-40e5-4508-a99a-28c42f5c17db]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:24 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 Apr 15 10:12:24 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:24 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f" returned: 0 in 0.441s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b622530-7ea9-4d07-b994-c1931a9c60ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f', 'volume_size': 2}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e89386-d447-4055-8c2d-f56933e6c478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:24 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Volume volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f (e6f4d7e0-5850-463c-8968-d001eb6daf2f): created successfully Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e89386-d447-4055-8c2d-f56933e6c478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Flow 'volume_create_manager' (6ecc9a7e-2544-476a-96f1-2dcfcd4b2c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-021cad72-c056-4aef-954e-31604c709bc6 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Created volume successfully. Apr 15 10:12:24 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828" returned: 0 in 0.539s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5b3090-f6f6-446d-830b-4af6fae58997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:24 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 Apr 15 10:12:24 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Acquiring lock "cinder-780f8e35-6b94-4347-83a3-518d347cd995-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Lock "cinder-780f8e35-6b94-4347-83a3-518d347cd995-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Acquiring lock "cinder-quobyte-780f8e35-6b94-4347-83a3-518d347cd995" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Lock "cinder-quobyte-780f8e35-6b94-4347-83a3-518d347cd995" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3274edb1-c584-4078-92ab-05eed40dee55]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-780f8e35-6b94-4347-83a3-518d347cd995 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:25 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-780f8e35-6b94-4347-83a3-518d347cd995 Apr 15 10:12:25 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:25 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3" returned: 0 in 0.481s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:25 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3 Apr 15 10:12:25 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:25 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-780f8e35-6b94-4347-83a3-518d347cd995" returned: 0 in 0.464s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-780f8e35-6b94-4347-83a3-518d347cd995 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:25 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-780f8e35-6b94-4347-83a3-518d347cd995 Apr 15 10:12:25 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:25 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3" returned: 0 in 0.403s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3" released by "_delete_snapshot" :: held 1.960s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" released by "delete_snapshot" :: held 2.005s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Created reservations ['3496baa9-d6f0-4698-8bf5-59799402b581', 'c3a5547d-58b8-470c-8a0b-abed663b5247', '31f92579-a437-4a8d-be13-4cd940945c70', '37f90b38-cc44-44e4-a6aa-a313f2e9afd1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Delete snapshot completed successfully. Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8abaa970-ad82-482e-b76e-2365948a3599 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-68f1f559-dab0-4f0b-a5c9-27eccbe9f0e3-delete_snapshot" released by "delete_snapshot" :: held 2.132s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Creating offline snapshot d91c377d-5721-4dd1-8799-99c446f3b612 of volume e6f4d7e0-5850-463c-8968-d001eb6daf2f {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36306ca-b288-494c-9631-058ee345a1ea]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:25 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f Apr 15 10:12:25 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:25 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-780f8e35-6b94-4347-83a3-518d347cd995" returned: 0 in 0.454s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Lock "cinder-quobyte-780f8e35-6b94-4347-83a3-518d347cd995" released by "delete_volume" :: held 0.942s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Created reservations ['87affd1b-d964-4a5f-a0f5-44d30576fe3b', 'bac750a7-b788-4583-8249-2573f42df1f0', '92db322b-b0fd-49b4-a7cb-087067122da2', '1ff73fb9-22db-46ae-994c-316e9e82e009'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:26 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:26 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:26 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f" returned: 0 in 0.526s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 2G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:26 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 2G Apr 15 10:12:26 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:26 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.517s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Deleted volume successfully. Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b30b13b-43fd-4444-be94-d0052d075124 tempest-VolumesMetadataTest-944388767 None] Lock "cinder-780f8e35-6b94-4347-83a3-518d347cd995-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:26 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 2G" returned: 0 in 0.599s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:27 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 Apr 15 10:12:27 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:27 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612" returned: 0 in 0.468s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:27 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 is being set with open permissions: ugo+rw Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:27 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 Apr 15 10:12:27 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:27 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612" returned: 0 in 0.430s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Flow 'volume_create_manager' (64f4f955-24db-4d19-b4ff-ef4f645cb50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a85a344-bbed-4068-899b-aa7cab79b2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a85a344-bbed-4068-899b-aa7cab79b2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2015555387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72699ad-6c4f-4c99-89f2-895203350719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c817d1731d14b1f86ba791426c978da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:28Z,use_quota=True,user_id='1c130c307ea54cbca988517399df170d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9d8f4f-fee3-4d7c-a55e-a271984274e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.info Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9d8f4f-fee3-4d7c-a55e-a271984274e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f73963d-10d0-49df-a922-c61abd02a295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f73963d-10d0-49df-a922-c61abd02a295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72699ad-6c4f-4c99-89f2-895203350719', 'volume_name': 'volume-c72699ad-6c4f-4c99-89f2-895203350719', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c9bf42-1582-41d0-ad74-860071ab6537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c9bf42-1582-41d0-ad74-860071ab6537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8f7bd0-f70b-4293-bd85-d1b8f65518c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:28 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Volume c72699ad-6c4f-4c99-89f2-895203350719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72699ad-6c4f-4c99-89f2-895203350719', 'volume_size': 1} Apr 15 10:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:28 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.info" returned: 0 in 0.391s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:28 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.info is being set with open permissions: ugo+rw Apr 15 10:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:28 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.info Apr 15 10:12:28 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:28 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.info" returned: 0 in 0.382s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.902s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.771s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] Creating offline snapshot 75feff80-3312-4eb6-8f67-99d4c2436579 of volume 7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:28 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c571acd2-0e6b-466c-bf44-feca3c89d971 tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Create snapshot completed successfully Apr 15 10:12:28 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b96df9-fe74-4ef7-a5b5-7321cbc3a553]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:28 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 Apr 15 10:12:28 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Acquiring lock "cinder-d91c377d-5721-4dd1-8799-99c446f3b612-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "cinder-d91c377d-5721-4dd1-8799-99c446f3b612-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Acquiring lock "cinder-quobyte-e6f4d7e0-5850-463c-8968-d001eb6daf2f" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "cinder-quobyte-e6f4d7e0-5850-463c-8968-d001eb6daf2f" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Acquiring lock "cinder-quobyte-d91c377d-5721-4dd1-8799-99c446f3b612" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "cinder-quobyte-d91c377d-5721-4dd1-8799-99c446f3b612" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Deleting offline snapshot d91c377d-5721-4dd1-8799-99c446f3b612 of volume e6f4d7e0-5850-463c-8968-d001eb6daf2f {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] snapshot_file for this snap is: volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8364b46-22cc-4877-b121-643f35e56740]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:29 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 Apr 15 10:12:29 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:29 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828" returned: 0 in 0.523s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5b3090-f6f6-446d-830b-4af6fae58997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:29 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 1G Apr 15 10:12:29 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:29 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612" returned: 0 in 0.502s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab50bc2-c508-43b7-b807-414d07e99e8d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:29 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f Apr 15 10:12:29 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:29 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 1G" returned: 0 in 0.537s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:29 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 Apr 15 10:12:29 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:30 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:30 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 Apr 15 10:12:30 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:30 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579" returned: 0 in 0.460s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:30 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 is being set with open permissions: ugo+rw Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:30 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 Apr 15 10:12:30 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:30 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612" returned: 0 in 0.470s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:30 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612 Apr 15 10:12:30 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:30 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579" returned: 0 in 0.456s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.790s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2015555387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72699ad-6c4f-4c99-89f2-895203350719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c817d1731d14b1f86ba791426c978da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:28Z,use_quota=True,user_id='1c130c307ea54cbca988517399df170d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Creating volume c72699ad-6c4f-4c99-89f2-895203350719 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:30 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:30 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 1073741824 Apr 15 10:12:30 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c996f93c-fb6b-431c-b17b-426b118bfdab tempest-SnapshotsActionsTest-1847403320 None] Create snapshot completed successfully Apr 15 10:12:31 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f.d91c377d-5721-4dd1-8799-99c446f3b612" returned: 0 in 0.508s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "cinder-quobyte-d91c377d-5721-4dd1-8799-99c446f3b612" released by "_delete_snapshot" :: held 2.078s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "cinder-quobyte-e6f4d7e0-5850-463c-8968-d001eb6daf2f" released by "delete_snapshot" :: held 2.091s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Acquiring lock "cinder-75feff80-3312-4eb6-8f67-99d4c2436579-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-75feff80-3312-4eb6-8f67-99d4c2436579-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Acquiring lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Created reservations ['a90abc84-5bb3-418b-a503-739ce6fe14ba', 'e6c58788-e9ec-4015-b900-74972ff717d6', 'fc0e89c4-3c65-4cf5-b7b2-9fa3529e9e8b', 'c59aaa6c-fdcf-4b8d-802b-64274cf50553'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Acquiring lock "cinder-quobyte-75feff80-3312-4eb6-8f67-99d4c2436579" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-75feff80-3312-4eb6-8f67-99d4c2436579" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Deleting offline snapshot 75feff80-3312-4eb6-8f67-99d4c2436579 of volume 7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] snapshot_file for this snap is: volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fd604e-d16a-4fab-80a7-7c187f434252]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Delete snapshot completed successfully. Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8097d86b-9160-4505-a02b-f05f7b66476b tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "cinder-d91c377d-5721-4dd1-8799-99c446f3b612-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:31 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 Apr 15 10:12:31 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:31 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 1073741824" returned: 0 in 0.693s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:31 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 Apr 15 10:12:31 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:31 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579" returned: 0 in 0.576s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5b3090-f6f6-446d-830b-4af6fae58997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3a292f-8686-4e09-a2d3-5740c0dfaeb8]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:31 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 Apr 15 10:12:31 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:32 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719" returned: 0 in 0.493s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8f7bd0-f70b-4293-bd85-d1b8f65518c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72699ad-6c4f-4c99-89f2-895203350719', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e4bca7-b681-4cde-a55e-db48a6a5cc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Volume volume-c72699ad-6c4f-4c99-89f2-895203350719 (c72699ad-6c4f-4c99-89f2-895203350719): created successfully Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e4bca7-b681-4cde-a55e-db48a6a5cc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Flow 'volume_create_manager' (64f4f955-24db-4d19-b4ff-ef4f645cb50c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0478d8ba-9ef3-4abb-b6e4-5c263a8e76f8 tempest-VolumesCloneTest-429843735 None] Created volume successfully. Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Acquiring lock "cinder-e6f4d7e0-5850-463c-8968-d001eb6daf2f-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "cinder-e6f4d7e0-5850-463c-8968-d001eb6daf2f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Acquiring lock "cinder-quobyte-e6f4d7e0-5850-463c-8968-d001eb6daf2f" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "cinder-quobyte-e6f4d7e0-5850-463c-8968-d001eb6daf2f" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f66776-f30e-46eb-8a69-0646362d0294]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:32 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f Apr 15 10:12:32 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:32 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828" returned: 0 in 0.575s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5b3090-f6f6-446d-830b-4af6fae58997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:32 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 Apr 15 10:12:32 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Flow 'volume_create_manager' (5befb0cd-a3ec-48a9-ad52-9c2ba83db0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cef59dc-90c7-41bc-ba2d-6316ee3e7bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cef59dc-90c7-41bc-ba2d-6316ee3e7bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1874117004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7b6c8e-14cf-487f-b704-ee823fe98a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c817d1731d14b1f86ba791426c978da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c72699ad-6c4f-4c99-89f2-895203350719,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:32Z,use_quota=True,user_id='1c130c307ea54cbca988517399df170d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb606ba-f421-49fa-bd2a-782a304bbfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb606ba-f421-49fa-bd2a-782a304bbfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed7e2e7-6b67-4196-b0b1-f75ec8f19154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed7e2e7-6b67-4196-b0b1-f75ec8f19154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8e7b6c8e-14cf-487f-b704-ee823fe98a78', 'volume_name': 'volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78', 'volume_size': 2, 'source_volid': 'c72699ad-6c4f-4c99-89f2-895203350719', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f9111a-efc4-4295-816f-ade71fabfd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f9111a-efc4-4295-816f-ade71fabfd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1383837-ca20-4038-b02f-1f7e297ede09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Volume 8e7b6c8e-14cf-487f-b704-ee823fe98a78: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78', 'volume_size': 2, 'source_volid': 'c72699ad-6c4f-4c99-89f2-895203350719', 'source_volstatus': 'available'} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:32 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Cloning volume c72699ad-6c4f-4c99-89f2-895203350719 to volume 8e7b6c8e-14cf-487f-b704-ee823fe98a78 Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Creating offline snapshot efa615e3-5efc-4447-bea7-45e325ce08c8 of volume c72699ad-6c4f-4c99-89f2-895203350719 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edd32b2-c09b-41c4-8f5f-9325b8d8059d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:32 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 Apr 15 10:12:32 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:32 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f" returned: 0 in 0.581s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:32 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f Apr 15 10:12:32 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:33 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579" returned: 0 in 0.566s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:33 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579 Apr 15 10:12:33 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:33 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719" returned: 0 in 0.525s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:33 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 1G Apr 15 10:12:33 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:33 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e6f4d7e0-5850-463c-8968-d001eb6daf2f" returned: 0 in 0.464s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "cinder-quobyte-e6f4d7e0-5850-463c-8968-d001eb6daf2f" released by "delete_volume" :: held 1.093s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Created reservations ['d5626121-7a40-4b61-b659-16749f72b08d', '8580ba44-9c91-4f2e-b4af-a6ff3a153816', 'fef5dcb3-c0fd-4710-982a-081bc51800e9', '0379d3cd-d873-4a50-a5d9-23b1cfbebd60'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:33 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.75feff80-3312-4eb6-8f67-99d4c2436579" returned: 0 in 0.528s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:33 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:33 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-75feff80-3312-4eb6-8f67-99d4c2436579" released by "_delete_snapshot" :: held 2.318s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" released by "delete_snapshot" :: held 2.334s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Created reservations ['e44d5692-9729-4d45-bd37-c257d391749f', 'ae889224-6e90-4ba2-b4c4-f42138f9b71c', '856f2f09-756e-4abc-929f-32510e7f0048', '41157201-832d-4170-9580-742d2ab0415f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Delete snapshot completed successfully. Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4f0a18c8-3af8-4cd1-b025-ba10d77b7dc6 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-75feff80-3312-4eb6-8f67-99d4c2436579-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:33 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 1G" returned: 0 in 0.532s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c72699ad-6c4f-4c99-89f2-895203350719 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:33 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c72699ad-6c4f-4c99-89f2-895203350719 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 Apr 15 10:12:33 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:33 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.459s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Deleted volume successfully. Apr 15 10:12:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1fd77821-1513-4596-9028-c0fc913c33ab tempest-VolumesSnapshotNegativeTestJSON-486581126 None] Lock "cinder-e6f4d7e0-5850-463c-8968-d001eb6daf2f-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:34 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c72699ad-6c4f-4c99-89f2-895203350719 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8" returned: 0 in 0.485s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:34 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 is being set with open permissions: ugo+rw Apr 15 10:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:34 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 Apr 15 10:12:34 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:34 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8" returned: 0 in 0.464s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:34 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.info Apr 15 10:12:34 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:35 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.info" returned: 0 in 0.468s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:35 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.info is being set with open permissions: ugo+rw Apr 15 10:12:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:35 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.info Apr 15 10:12:35 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:35 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.info" returned: 0 in 0.473s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Acquiring lock "cinder-quobyte-8e7b6c8e-14cf-487f-b704-ee823fe98a78" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Lock "cinder-quobyte-8e7b6c8e-14cf-487f-b704-ee823fe98a78" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] snapshot: efa615e3-5efc-4447-bea7-45e325ce08c8, volume: 8e7b6c8e-14cf-487f-b704-ee823fe98a78, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:12:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13bcc20-d6b8-472d-9656-c9f187868ca4]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:35 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 Apr 15 10:12:35 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:36 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8" returned: 0 in 0.540s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c72699ad-6c4f-4c99-89f2-895203350719(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] will copy from snapshot at /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a10989-2f9f-49e6-ad1d-abc696b325de]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:36 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 Apr 15 10:12:36 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Flow 'volume_create_manager' (bdab6ddb-1459-44d2-be2f-b6ea13cfced7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417da210-a2f7-4b74-a7df-d2e25d81255d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417da210-a2f7-4b74-a7df-d2e25d81255d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a5cf2a-13da-4774-9318-c5ce9c85dc89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20994a866a3b4c5c959ceee71027488e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:36Z,use_quota=True,user_id='b5c900785e9e4676a40da018896fe930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a07824-ba07-4ee7-b603-ecaf0cf755e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a07824-ba07-4ee7-b603-ecaf0cf755e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b236c85b-22ca-4254-a1b6-3b703c963267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b236c85b-22ca-4254-a1b6-3b703c963267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a5cf2a-13da-4774-9318-c5ce9c85dc89', 'volume_name': 'volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a2f2b8-311a-40c5-bf2f-9bc4812215f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a2f2b8-311a-40c5-bf2f-9bc4812215f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe1700a-a46e-4931-8731-3b75f9777961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:36 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Volume 78a5cf2a-13da-4774-9318-c5ce9c85dc89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89', 'volume_size': 1} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:36 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719" returned: 0 in 0.523s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Path /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:12:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:36 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78 Apr 15 10:12:36 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:37 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:12:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:37 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:37 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:38 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.041s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:38 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:38 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78" returned: 0 in 2.152s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:38 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c07871-aab7-4e63-a0f0-54ae42112521]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:38 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 Apr 15 10:12:38 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:39 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719" returned: 0 in 0.554s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:39 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:12:39 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Converted 1024.00 MB image at 475.68 MB/s Apr 15 10:12:39 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78 is being set with open permissions: ugo+rw Apr 15 10:12:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:39 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78 Apr 15 10:12:39 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:39 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78" returned: 0 in 0.388s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Lock "cinder-quobyte-8e7b6c8e-14cf-487f-b704-ee823fe98a78" released by "_copy_volume_from_snapshot" :: held 4.205s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Acquiring lock "cinder-quobyte-efa615e3-5efc-4447-bea7-45e325ce08c8" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Lock "cinder-quobyte-efa615e3-5efc-4447-bea7-45e325ce08c8" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Deleting offline snapshot efa615e3-5efc-4447-bea7-45e325ce08c8 of volume c72699ad-6c4f-4c99-89f2-895203350719 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] snapshot_file for this snap is: volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:39 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a83bf8-a3f8-4d57-8a7c-b22eea7ea93a]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:39 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 Apr 15 10:12:39 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:40 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8" returned: 0 in 0.451s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c72699ad-6c4f-4c99-89f2-895203350719(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:40 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cb5961-8383-401c-8ed5-de80fa16e338]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:40 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 Apr 15 10:12:40 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:40 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719" returned: 0 in 0.466s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:40 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 Apr 15 10:12:40 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:41 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8" returned: 0 in 0.452s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:41 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8 Apr 15 10:12:41 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:41 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719.efa615e3-5efc-4447-bea7-45e325ce08c8" returned: 0 in 0.393s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Lock "cinder-quobyte-efa615e3-5efc-4447-bea7-45e325ce08c8" released by "_delete_snapshot" :: held 1.813s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.090s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.089s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1383837-ca20-4038-b02f-1f7e297ede09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78', 'volume_size': 2, 'source_volid': 'c72699ad-6c4f-4c99-89f2-895203350719', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42234a1a-c883-4194-8617-f4c3ca881d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] Creating offline snapshot 57ed5c87-373c-4dbf-8db6-aa5b30666ef3 of volume 7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:41 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Volume volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78 (8e7b6c8e-14cf-487f-b704-ee823fe98a78): created successfully Apr 15 10:12:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42234a1a-c883-4194-8617-f4c3ca881d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Flow 'volume_create_manager' (5befb0cd-a3ec-48a9-ad52-9c2ba83db0e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:41 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[981650b3-9901-4692-90e9-accbbc898ec0]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:41 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b224058f-8bac-40f9-933f-b50399cd3a87 tempest-VolumesCloneTest-429843735 None] Created volume successfully. Apr 15 10:12:41 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 Apr 15 10:12:41 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Acquiring lock "cinder-8e7b6c8e-14cf-487f-b704-ee823fe98a78-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Lock "cinder-8e7b6c8e-14cf-487f-b704-ee823fe98a78-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Acquiring lock "cinder-quobyte-8e7b6c8e-14cf-487f-b704-ee823fe98a78" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Lock "cinder-quobyte-8e7b6c8e-14cf-487f-b704-ee823fe98a78" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:42 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[071b17ce-4642-4a93-afca-4375fefe4a98]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:42 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78 Apr 15 10:12:42 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:42 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828" returned: 0 in 0.502s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5b3090-f6f6-446d-830b-4af6fae58997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:42 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 1G Apr 15 10:12:42 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:42 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78" returned: 0 in 0.488s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:42 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78 Apr 15 10:12:42 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:42 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 1G" returned: 0 in 0.472s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:42 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 Apr 15 10:12:42 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:43 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8e7b6c8e-14cf-487f-b704-ee823fe98a78" returned: 0 in 0.401s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Lock "cinder-quobyte-8e7b6c8e-14cf-487f-b704-ee823fe98a78" released by "delete_volume" :: held 0.913s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Created reservations ['84ad0123-54b8-4f31-9048-66dabc2fa45d', 'f7df7cc5-27e9-41b1-bda2-25b18ec4f9fb', 'df3d5318-6389-4a6f-b887-6576b2dc9390', '55c0ab03-41e7-4df2-8f32-46731e11fe27'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:43 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3" returned: 0 in 0.436s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:43 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 is being set with open permissions: ugo+rw Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:43 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:43 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:43 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 Apr 15 10:12:43 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Acquiring lock "cinder-c72699ad-6c4f-4c99-89f2-895203350719-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Lock "cinder-c72699ad-6c4f-4c99-89f2-895203350719-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Acquiring lock "cinder-quobyte-c72699ad-6c4f-4c99-89f2-895203350719" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Lock "cinder-quobyte-c72699ad-6c4f-4c99-89f2-895203350719" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[692d0495-27b8-48f5-b942-b70fc402122d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:43 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 Apr 15 10:12:43 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:43 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.422s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:43 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Deleted volume successfully. Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-62271694-99b4-405f-a17c-65f5f1d2faa3 tempest-VolumesCloneTest-429843735 None] Lock "cinder-8e7b6c8e-14cf-487f-b704-ee823fe98a78-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:43 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3" returned: 0 in 0.443s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.091s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a5cf2a-13da-4774-9318-c5ce9c85dc89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20994a866a3b4c5c959ceee71027488e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:36Z,use_quota=True,user_id='b5c900785e9e4676a40da018896fe930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Creating volume 78a5cf2a-13da-4774-9318-c5ce9c85dc89 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:43 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:43 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89 1073741824 Apr 15 10:12:43 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:43 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-aa7ce6a3-0bd3-492d-add4-c5c3e77879e8 tempest-SnapshotsActionsTest-1847403320 None] Create snapshot completed successfully Apr 15 10:12:43 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719" returned: 0 in 0.509s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:43 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719 Apr 15 10:12:43 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Acquiring lock "cinder-57ed5c87-373c-4dbf-8db6-aa5b30666ef3-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-57ed5c87-373c-4dbf-8db6-aa5b30666ef3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Acquiring lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Acquiring lock "cinder-quobyte-57ed5c87-373c-4dbf-8db6-aa5b30666ef3" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-57ed5c87-373c-4dbf-8db6-aa5b30666ef3" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Deleting offline snapshot 57ed5c87-373c-4dbf-8db6-aa5b30666ef3 of volume 7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] snapshot_file for this snap is: volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a9a862-6f5f-4503-8db4-ee3434f4e1cd]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:44 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 Apr 15 10:12:44 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:44 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89 1073741824" returned: 0 in 0.539s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:44 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89 Apr 15 10:12:44 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:44 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c72699ad-6c4f-4c99-89f2-895203350719" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Lock "cinder-quobyte-c72699ad-6c4f-4c99-89f2-895203350719" released by "delete_volume" :: held 1.045s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Created reservations ['92bc435b-38ff-471a-a260-d7b1a9b0058e', '43450826-72ab-4703-b4ce-f8a05eb9e886', '0da3f95b-43ce-46bc-abc4-208446e92155', 'baf633cd-c843-468a-bfd6-a947e251c388'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:44 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:44 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:44 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3" returned: 0 in 0.552s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5b3090-f6f6-446d-830b-4af6fae58997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d17aaf-1b8d-406f-8527-fe97f553b020]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:44 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89" returned: 0 in 0.428s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe1700a-a46e-4931-8731-3b75f9777961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a3bd56-4589-422f-8eb7-0613c65130bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:44 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Volume volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89 (78a5cf2a-13da-4774-9318-c5ce9c85dc89): created successfully Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a3bd56-4589-422f-8eb7-0613c65130bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Flow 'volume_create_manager' (bdab6ddb-1459-44d2-be2f-b6ea13cfced7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cf3a9aa7-127f-4bf9-845e-e38d272a9d36 tempest-CinderUnicodeTest-1056708065 None] Created volume successfully. Apr 15 10:12:44 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 Apr 15 10:12:44 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:44 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.405s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Deleted volume successfully. Apr 15 10:12:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0b6cbcae-5cb0-4abc-9a17-a096670990b7 tempest-VolumesCloneTest-429843735 None] Lock "cinder-c72699ad-6c4f-4c99-89f2-895203350719-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:45 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828" returned: 0 in 0.503s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5b3090-f6f6-446d-830b-4af6fae58997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:45 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 Apr 15 10:12:45 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Flow 'volume_create_manager' (300f3bf8-2eb7-4ad0-87b8-4ab5e4b337fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92ffa48-5507-40c5-9f86-a884ce3a74d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92ffa48-5507-40c5-9f86-a884ce3a74d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-125850016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5954f839-00f8-49f7-9784-9d8ed686aef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20994a866a3b4c5c959ceee71027488e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:45Z,use_quota=True,user_id='b5c900785e9e4676a40da018896fe930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c54864-2b36-46fe-8861-a6451c9d5975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c54864-2b36-46fe-8861-a6451c9d5975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19c9d13-c88b-41dd-878f-ca8316e1525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19c9d13-c88b-41dd-878f-ca8316e1525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5954f839-00f8-49f7-9784-9d8ed686aef4', 'volume_name': 'volume-5954f839-00f8-49f7-9784-9d8ed686aef4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419c39fe-407c-4822-ba7d-2388b0456fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419c39fe-407c-4822-ba7d-2388b0456fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354536b6-a63f-4581-8ae7-66c5c80f5eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:45 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Volume 5954f839-00f8-49f7-9784-9d8ed686aef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5954f839-00f8-49f7-9784-9d8ed686aef4', 'volume_size': 1} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-125850016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5954f839-00f8-49f7-9784-9d8ed686aef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20994a866a3b4c5c959ceee71027488e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:45Z,use_quota=True,user_id='b5c900785e9e4676a40da018896fe930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Creating volume 5954f839-00f8-49f7-9784-9d8ed686aef4 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:45 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:45 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4 1073741824 Apr 15 10:12:45 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:45 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:45 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3 Apr 15 10:12:45 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:45 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4 1073741824" returned: 0 in 0.538s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:45 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4 Apr 15 10:12:45 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:46 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.57ed5c87-373c-4dbf-8db6-aa5b30666ef3" returned: 0 in 0.483s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-57ed5c87-373c-4dbf-8db6-aa5b30666ef3" released by "_delete_snapshot" :: held 2.130s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" released by "delete_snapshot" :: held 2.144s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:46 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Created reservations ['80843649-af3e-41df-b8a6-a80bf518fc53', '1172e77d-c61d-4cd5-8af0-9bf5d6bdbf67', '68594aca-2ca8-4b6a-89c0-e9ddc3efd3af', 'af0e1091-e800-4a48-9e25-5c95bf664146'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Delete snapshot completed successfully. Apr 15 10:12:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e2a1677b-9deb-40a2-90d4-14ee8df29e92 tempest-SnapshotsActionsTest-2139618561 None] Lock "cinder-57ed5c87-373c-4dbf-8db6-aa5b30666ef3-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:46 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4" returned: 0 in 0.452s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354536b6-a63f-4581-8ae7-66c5c80f5eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5954f839-00f8-49f7-9784-9d8ed686aef4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87eb424d-8893-4943-9cb4-a541c78d18df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:46 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Volume volume-5954f839-00f8-49f7-9784-9d8ed686aef4 (5954f839-00f8-49f7-9784-9d8ed686aef4): created successfully Apr 15 10:12:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87eb424d-8893-4943-9cb4-a541c78d18df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Flow 'volume_create_manager' (300f3bf8-2eb7-4ad0-87b8-4ab5e4b337fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-867f3d69-9636-4553-aa25-5bfe89ea89f2 tempest-CinderUnicodeTest-1056708065 None] Created volume successfully. Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Flow 'volume_create_manager' (39f4c685-bfbb-4da1-a68f-95abcfe9d4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61844912-081d-49a4-932d-e77465b1bdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61844912-081d-49a4-932d-e77465b1bdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-826302112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3ea380-25ba-4986-9213-4232b66afa6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e465310ff4a94f0088d887b5e878df5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:47Z,use_quota=True,user_id='6f5bff9823194e5b99d55434a644c704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bc490a-5abd-4fb5-8b69-af0b4e6e9134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bc490a-5abd-4fb5-8b69-af0b4e6e9134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ee2b68-87ba-420f-86fb-c81e541d6555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ee2b68-87ba-420f-86fb-c81e541d6555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a3ea380-25ba-4986-9213-4232b66afa6d', 'volume_name': 'volume-6a3ea380-25ba-4986-9213-4232b66afa6d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79004703-63f5-4940-b6de-4b74f8aa86eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79004703-63f5-4940-b6de-4b74f8aa86eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5f05d9-f235-461f-bdaf-d916ec2c9a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:47 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Volume 6a3ea380-25ba-4986-9213-4232b66afa6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a3ea380-25ba-4986-9213-4232b66afa6d', 'volume_size': 1} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-826302112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3ea380-25ba-4986-9213-4232b66afa6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e465310ff4a94f0088d887b5e878df5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:47Z,use_quota=True,user_id='6f5bff9823194e5b99d55434a644c704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Creating volume 6a3ea380-25ba-4986-9213-4232b66afa6d {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:47 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6a3ea380-25ba-4986-9213-4232b66afa6d 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:47 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6a3ea380-25ba-4986-9213-4232b66afa6d 1073741824 Apr 15 10:12:47 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Acquiring lock "cinder-8c346aac-a617-42fb-811b-8015c9a8c828-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Lock "cinder-8c346aac-a617-42fb-811b-8015c9a8c828-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Acquiring lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Acquiring lock "cinder-quobyte-8c346aac-a617-42fb-811b-8015c9a8c828" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Lock "cinder-quobyte-8c346aac-a617-42fb-811b-8015c9a8c828" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Deleting offline snapshot 8c346aac-a617-42fb-811b-8015c9a8c828 of volume 7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] snapshot_file for this snap is: volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c2442f-d039-4b16-b8ed-da93e1a870fd]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:47 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 Apr 15 10:12:47 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:47 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6a3ea380-25ba-4986-9213-4232b66afa6d 1073741824" returned: 0 in 0.527s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6a3ea380-25ba-4986-9213-4232b66afa6d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:47 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6a3ea380-25ba-4986-9213-4232b66afa6d Apr 15 10:12:47 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:48 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828" returned: 0 in 0.479s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5b3090-f6f6-446d-830b-4af6fae58997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe91b957-e566-4781-b5ff-1d33a141bc6e]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:48 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997 Apr 15 10:12:48 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:48 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6a3ea380-25ba-4986-9213-4232b66afa6d" returned: 0 in 0.409s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.702s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5f05d9-f235-461f-bdaf-d916ec2c9a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a3ea380-25ba-4986-9213-4232b66afa6d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e4cc06-b843-4892-a754-75cb31e8636e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:48 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Volume volume-6a3ea380-25ba-4986-9213-4232b66afa6d (6a3ea380-25ba-4986-9213-4232b66afa6d): created successfully Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e4cc06-b843-4892-a754-75cb31e8636e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Flow 'volume_create_manager' (39f4c685-bfbb-4da1-a68f-95abcfe9d4cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] Creating offline snapshot 483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 of volume 5954f839-00f8-49f7-9784-9d8ed686aef4 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-73941042-904d-4d5d-b596-6486719bd5b4 tempest-VolumesListTestJSON-869214956 None] Created volume successfully. Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[614e5ef6-e4a2-49a7-b23a-28fa07e698d7]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:48 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4 Apr 15 10:12:48 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:48 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997" returned: 0 in 0.472s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:48 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 Apr 15 10:12:48 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:48 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4" returned: 0 in 0.466s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:48 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 1G Apr 15 10:12:48 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:48 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828" returned: 0 in 0.440s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:48 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828 Apr 15 10:12:48 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:49 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 1G" returned: 0 in 0.475s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5954f839-00f8-49f7-9784-9d8ed686aef4 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:49 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5954f839-00f8-49f7-9784-9d8ed686aef4 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 Apr 15 10:12:49 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:49 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997.8c346aac-a617-42fb-811b-8015c9a8c828" returned: 0 in 0.432s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Lock "cinder-quobyte-8c346aac-a617-42fb-811b-8015c9a8c828" released by "_delete_snapshot" :: held 1.887s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" released by "delete_snapshot" :: held 1.904s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Created reservations ['594a8b1f-35e9-4902-834a-7296f5ed98dd', '8056b9ae-8441-454f-a126-ff26cf76515c', '027e8923-0957-45d0-8a85-a27e9cb9c4c4', '8ecef649-3caa-4e7a-a74a-c941e68b4379'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:49 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Delete snapshot completed successfully. Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-705a975a-2a0b-4884-ad3e-43d7ff0cc745 tempest-SnapshotsActionsTest-1847403320 None] Lock "cinder-8c346aac-a617-42fb-811b-8015c9a8c828-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Flow 'volume_create_manager' (fcbbe5a4-160c-498d-8142-0736375d848d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11385939-8d1d-40d5-b32a-6fcce15063bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Acquiring lock "cinder-7b5b3090-f6f6-446d-830b-4af6fae58997-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11385939-8d1d-40d5-b32a-6fcce15063bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-93608445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82934d02-ec14-4812-9d1c-3c878fe0616c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e465310ff4a94f0088d887b5e878df5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:50Z,use_quota=True,user_id='6f5bff9823194e5b99d55434a644c704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd05a18-604e-4740-b6fb-d12bb6a60e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd05a18-604e-4740-b6fb-d12bb6a60e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09aa5ad-95b1-44be-9597-197bfbaa18f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09aa5ad-95b1-44be-9597-197bfbaa18f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82934d02-ec14-4812-9d1c-3c878fe0616c', 'volume_name': 'volume-82934d02-ec14-4812-9d1c-3c878fe0616c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8059fefd-2d0b-4523-99dd-495651340aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8059fefd-2d0b-4523-99dd-495651340aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129e3f1a-4928-46a0-a73f-947148e41a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:49 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Volume 82934d02-ec14-4812-9d1c-3c878fe0616c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82934d02-ec14-4812-9d1c-3c878fe0616c', 'volume_size': 1} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Lock "cinder-7b5b3090-f6f6-446d-830b-4af6fae58997-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Acquiring lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3422cc60-4fd2-486e-8a15-76b6a447fb2e]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:49 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5954f839-00f8-49f7-9784-9d8ed686aef4 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365" returned: 0 in 0.503s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:49 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 is being set with open permissions: ugo+rw Apr 15 10:12:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:49 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 Apr 15 10:12:49 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:49 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997 Apr 15 10:12:49 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:50 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365" returned: 0 in 0.406s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:50 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997" returned: 0 in 0.470s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:50 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.info Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:50 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:50 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997 Apr 15 10:12:50 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:50 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7b5b3090-f6f6-446d-830b-4af6fae58997" returned: 0 in 0.390s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Lock "cinder-quobyte-7b5b3090-f6f6-446d-830b-4af6fae58997" released by "delete_volume" :: held 0.887s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:50 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.info" returned: 0 in 0.423s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:50 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.info is being set with open permissions: ugo+rw Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:50 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.info Apr 15 10:12:50 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Created reservations ['0a225f19-a70b-420f-acc2-0e18cfa009dc', '63503a36-c451-4283-9c2f-b17b785233dc', '67a9b9a9-773e-41f5-acc0-ea0bd7117a0b', '11db812e-d395-4767-9f43-07d4a72d2fc2'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:50 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:50 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:51 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.info" returned: 0 in 0.486s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-93608445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82934d02-ec14-4812-9d1c-3c878fe0616c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e465310ff4a94f0088d887b5e878df5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:50Z,use_quota=True,user_id='6f5bff9823194e5b99d55434a644c704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Creating volume 82934d02-ec14-4812-9d1c-3c878fe0616c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:51 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82934d02-ec14-4812-9d1c-3c878fe0616c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:51 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82934d02-ec14-4812-9d1c-3c878fe0616c 1073741824 Apr 15 10:12:51 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:51 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f3397a4f-dffa-4148-90df-edc1db520959 tempest-CinderUnicodeTest-1056708065 None] Create snapshot completed successfully Apr 15 10:12:51 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.506s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:51 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Deleted volume successfully. Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-32593f4a-5d6c-448f-9e95-b33b6435a291 tempest-SnapshotsActionsTest-1847403320 None] Lock "cinder-7b5b3090-f6f6-446d-830b-4af6fae58997-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:51 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82934d02-ec14-4812-9d1c-3c878fe0616c 1073741824" returned: 0 in 0.579s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82934d02-ec14-4812-9d1c-3c878fe0616c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:51 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82934d02-ec14-4812-9d1c-3c878fe0616c Apr 15 10:12:51 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "cinder-483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "cinder-quobyte-5954f839-00f8-49f7-9784-9d8ed686aef4" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-quobyte-5954f839-00f8-49f7-9784-9d8ed686aef4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "cinder-quobyte-483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-quobyte-483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Deleting offline snapshot 483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 of volume 5954f839-00f8-49f7-9784-9d8ed686aef4 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] snapshot_file for this snap is: volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84e9878-42d3-402b-8c8e-7f6fb8f66ff5]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:52 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 Apr 15 10:12:52 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:52 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82934d02-ec14-4812-9d1c-3c878fe0616c" returned: 0 in 0.464s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129e3f1a-4928-46a0-a73f-947148e41a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82934d02-ec14-4812-9d1c-3c878fe0616c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bbb7d6c-1b20-4a86-92e5-e777d7f86378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:52 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Volume volume-82934d02-ec14-4812-9d1c-3c878fe0616c (82934d02-ec14-4812-9d1c-3c878fe0616c): created successfully Apr 15 10:12:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bbb7d6c-1b20-4a86-92e5-e777d7f86378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Flow 'volume_create_manager' (fcbbe5a4-160c-498d-8142-0736375d848d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:52 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-397a5e94-d5d6-427f-88fb-e73f89b7ee4c tempest-VolumesListTestJSON-869214956 None] Created volume successfully. Apr 15 10:12:52 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365" returned: 0 in 0.534s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5954f839-00f8-49f7-9784-9d8ed686aef4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:52 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea20d705-a9e0-44bd-98e5-d3c530341f31]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:52 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4 Apr 15 10:12:52 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:53 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4" returned: 0 in 0.537s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:53 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 Apr 15 10:12:53 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Flow 'volume_create_manager' (3bf208e1-891e-4104-b14d-a028be00e7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5546637e-ebc5-46b6-b4f1-3f7335e85c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5546637e-ebc5-46b6-b4f1-3f7335e85c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1125041671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc3a051-421b-49ca-bf49-e1be62d29ee9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e465310ff4a94f0088d887b5e878df5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:53Z,use_quota=True,user_id='6f5bff9823194e5b99d55434a644c704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdf903f-49f2-40bb-8dda-19482346d5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdf903f-49f2-40bb-8dda-19482346d5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068a46ad-8e25-4c0e-88cc-968b34e0790c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068a46ad-8e25-4c0e-88cc-968b34e0790c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fc3a051-421b-49ca-bf49-e1be62d29ee9', 'volume_name': 'volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbe3175-b097-42ab-98b9-520622cd4ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbe3175-b097-42ab-98b9-520622cd4ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd21b20-cbe2-4ca3-b75c-e8ed3b83aa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:53 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Volume 8fc3a051-421b-49ca-bf49-e1be62d29ee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9', 'volume_size': 1} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1125041671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc3a051-421b-49ca-bf49-e1be62d29ee9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e465310ff4a94f0088d887b5e878df5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:53Z,use_quota=True,user_id='6f5bff9823194e5b99d55434a644c704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Creating volume 8fc3a051-421b-49ca-bf49-e1be62d29ee9 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:53 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:53 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9 1073741824 Apr 15 10:12:53 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:53 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365" returned: 0 in 0.542s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:53 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365 Apr 15 10:12:53 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:53 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9 1073741824" returned: 0 in 0.556s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:53 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9 Apr 15 10:12:53 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:54 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4.483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365" returned: 0 in 0.489s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-quobyte-483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365" released by "_delete_snapshot" :: held 2.160s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-quobyte-5954f839-00f8-49f7-9784-9d8ed686aef4" released by "delete_snapshot" :: held 2.173s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:54 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Created reservations ['77016f84-c299-44d3-a5f6-d352580f97d8', '96e0ba69-056e-4a96-b12d-895e4cf7a8f4', 'a4e6be92-d751-4060-b625-3bb40107417e', 'f26d0e8e-7a0a-45b4-8a77-1b74b9bddf35'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:54 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Delete snapshot completed successfully. Apr 15 10:12:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c6d382c9-361f-4064-ac23-5154a8a02882 tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-483ddeac-4f8d-4fc5-8fa4-c1ebd83c3365-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:54 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9" returned: 0 in 0.479s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd21b20-cbe2-4ca3-b75c-e8ed3b83aa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eba23d-4272-40b9-b289-411e4fc3be7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:54 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Volume volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9 (8fc3a051-421b-49ca-bf49-e1be62d29ee9): created successfully Apr 15 10:12:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eba23d-4272-40b9-b289-411e4fc3be7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Flow 'volume_create_manager' (3bf208e1-891e-4104-b14d-a028be00e7c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:54 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7e5b36a2-2189-4ca6-8de1-c1d922c48ace tempest-VolumesListTestJSON-869214956 None] Created volume successfully. Apr 15 10:12:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "cinder-5954f839-00f8-49f7-9784-9d8ed686aef4-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-5954f839-00f8-49f7-9784-9d8ed686aef4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "cinder-quobyte-5954f839-00f8-49f7-9784-9d8ed686aef4" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-quobyte-5954f839-00f8-49f7-9784-9d8ed686aef4" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:55 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[382a209e-a8e7-4195-bf3d-2d91ac6ddb85]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:55 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4 Apr 15 10:12:55 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:55 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:55 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4 Apr 15 10:12:55 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:56 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5954f839-00f8-49f7-9784-9d8ed686aef4" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-quobyte-5954f839-00f8-49f7-9784-9d8ed686aef4" released by "delete_volume" :: held 1.129s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:56 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Created reservations ['3ef33f39-f5f8-4386-940f-91a83f7b8a1a', 'f9505b7c-8ed9-40bd-9f88-1470faa93788', 'ccaa19c4-e1fe-4e1e-8782-52722dc110a5', '38dedd1b-887e-4a72-9cce-808a3425f117'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:56 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:56 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:56 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.501s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:56 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Deleted volume successfully. Apr 15 10:12:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-255a2d54-0888-4d31-880f-2d93f3ad3bdc tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-5954f839-00f8-49f7-9784-9d8ed686aef4-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "cinder-78a5cf2a-13da-4774-9318-c5ce9c85dc89-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-78a5cf2a-13da-4774-9318-c5ce9c85dc89-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "cinder-quobyte-78a5cf2a-13da-4774-9318-c5ce9c85dc89" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-quobyte-78a5cf2a-13da-4774-9318-c5ce9c85dc89" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c13927-0d34-4783-9d08-ad726eb49570]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:57 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89 Apr 15 10:12:57 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Acquiring lock "cinder-8fc3a051-421b-49ca-bf49-e1be62d29ee9-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Lock "cinder-8fc3a051-421b-49ca-bf49-e1be62d29ee9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Acquiring lock "cinder-quobyte-8fc3a051-421b-49ca-bf49-e1be62d29ee9" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Lock "cinder-quobyte-8fc3a051-421b-49ca-bf49-e1be62d29ee9" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a78af8-4406-4750-9657-b6955d3790eb]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:57 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9 Apr 15 10:12:57 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:57 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Flow 'volume_create_manager' (bc90a466-0fd7-4661-ae33-df7b343dad17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3e3701-99a3-49d4-a799-6ccd04cae330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89" returned: 0 in 0.600s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:57 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89 Apr 15 10:12:57 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3e3701-99a3-49d4-a799-6ccd04cae330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-654766483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78b475d-9996-4cfa-a595-e7c1946a7cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37cae64d88d64ce6a383e58036a78592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:58Z,use_quota=True,user_id='e1e560444e7a4e549431f7b522276a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff2a01a-7e97-4665-9187-4f41904d3a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff2a01a-7e97-4665-9187-4f41904d3a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c0c611-b2d5-44d4-acd9-ed87860a67af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c0c611-b2d5-44d4-acd9-ed87860a67af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f78b475d-9996-4cfa-a595-e7c1946a7cbf', 'volume_name': 'volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9465ef25-0a18-47c5-8b66-cd5381957abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9465ef25-0a18-47c5-8b66-cd5381957abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ab96de-9dcd-46d2-96f0-075ab73a9cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:57 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Volume f78b475d-9996-4cfa-a595-e7c1946a7cbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf', 'volume_size': 1} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-654766483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78b475d-9996-4cfa-a595-e7c1946a7cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37cae64d88d64ce6a383e58036a78592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:58Z,use_quota=True,user_id='e1e560444e7a4e549431f7b522276a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Creating volume f78b475d-9996-4cfa-a595-e7c1946a7cbf {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:57 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:12:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:57 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf 1073741824 Apr 15 10:12:57 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:58 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9" returned: 0 in 0.540s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:58 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9 Apr 15 10:12:58 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:58 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-78a5cf2a-13da-4774-9318-c5ce9c85dc89" returned: 0 in 0.405s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-quobyte-78a5cf2a-13da-4774-9318-c5ce9c85dc89" released by "delete_volume" :: held 1.041s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Created reservations ['ddad1087-a152-4d68-a44a-e7ba31457fa8', '6b864446-c5a9-4aa5-bd19-8204f08bffc2', '2d5e5068-291a-42b8-bab5-afd3760b5454', '1270c646-980f-4523-9404-0ddab98fcb05'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:58 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:58 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:58 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf 1073741824" returned: 0 in 0.551s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:58 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:58 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf Apr 15 10:12:58 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8fc3a051-421b-49ca-bf49-e1be62d29ee9" returned: 0 in 0.445s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Lock "cinder-quobyte-8fc3a051-421b-49ca-bf49-e1be62d29ee9" released by "delete_volume" :: held 1.016s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Created reservations ['f6459297-251c-4528-9fec-9012b57f17ee', 'e52a186f-a9ae-4d3c-a4f1-eaeb363b8cfd', '475a6090-9bd1-4089-bdef-794b9a9631a7', 'c005d6eb-d086-40e0-bbda-306816e0a427'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:58 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:58 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Acquiring lock "cinder-82934d02-ec14-4812-9d1c-3c878fe0616c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Lock "cinder-82934d02-ec14-4812-9d1c-3c878fe0616c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:58 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.474s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:58 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Deleted volume successfully. Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Acquiring lock "cinder-quobyte-82934d02-ec14-4812-9d1c-3c878fe0616c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-19c82166-7a61-4386-9996-dca0acf8e08c tempest-CinderUnicodeTest-1056708065 None] Lock "cinder-78a5cf2a-13da-4774-9318-c5ce9c85dc89-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Lock "cinder-quobyte-82934d02-ec14-4812-9d1c-3c878fe0616c" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:58 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13bcab2-c3ff-401b-ad24-4b225ac3725c]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82934d02-ec14-4812-9d1c-3c878fe0616c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf" returned: 0 in 0.432s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ab96de-9dcd-46d2-96f0-075ab73a9cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb4b11e-1c86-4153-996c-335dbea19690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:58 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Volume volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf (f78b475d-9996-4cfa-a595-e7c1946a7cbf): created successfully Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb4b11e-1c86-4153-996c-335dbea19690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Flow 'volume_create_manager' (bc90a466-0fd7-4661-ae33-df7b343dad17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:58 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-aaf128dc-e6d1-41b8-9d2e-2960bb5fc089 tempest-VolumesServicesTestJSON-2023444933 None] Created volume successfully. Apr 15 10:12:59 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82934d02-ec14-4812-9d1c-3c878fe0616c Apr 15 10:12:59 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:59 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.491s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Deleted volume successfully. Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ab314d8a-4a8e-47ef-bea6-b4d63511952c tempest-VolumesListTestJSON-869214956 None] Lock "cinder-8fc3a051-421b-49ca-bf49-e1be62d29ee9-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:59 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82934d02-ec14-4812-9d1c-3c878fe0616c" returned: 0 in 0.473s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82934d02-ec14-4812-9d1c-3c878fe0616c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:59 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82934d02-ec14-4812-9d1c-3c878fe0616c Apr 15 10:12:59 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:59 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82934d02-ec14-4812-9d1c-3c878fe0616c" returned: 0 in 0.451s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Lock "cinder-quobyte-82934d02-ec14-4812-9d1c-3c878fe0616c" released by "delete_volume" :: held 0.943s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Created reservations ['63cf24de-a86c-490a-833d-cd5fe8077f19', 'f06b7531-0ef0-45c2-8233-35935d7dd5ce', '30236854-d879-406d-9dab-d88a2ce3c4ad', '6e77f8f0-20a0-44e0-8cbd-e0cdbe3a85c9'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:59 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:12:59 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Acquiring lock "cinder-6a3ea380-25ba-4986-9213-4232b66afa6d-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Lock "cinder-6a3ea380-25ba-4986-9213-4232b66afa6d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Acquiring lock "cinder-quobyte-6a3ea380-25ba-4986-9213-4232b66afa6d" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Lock "cinder-quobyte-6a3ea380-25ba-4986-9213-4232b66afa6d" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Acquiring lock "cinder-f78b475d-9996-4cfa-a595-e7c1946a7cbf-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac45ade-40a8-4922-a03a-fbe962ca5c78]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6a3ea380-25ba-4986-9213-4232b66afa6d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Lock "cinder-f78b475d-9996-4cfa-a595-e7c1946a7cbf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Acquiring lock "cinder-quobyte-f78b475d-9996-4cfa-a595-e7c1946a7cbf" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Lock "cinder-quobyte-f78b475d-9996-4cfa-a595-e7c1946a7cbf" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:00 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6a3ea380-25ba-4986-9213-4232b66afa6d Apr 15 10:13:00 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecff625-7b45-4178-ae14-6518e99a799f]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:00 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf Apr 15 10:13:00 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:00 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.553s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:00 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Deleted volume successfully. Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9d0e4d7a-47cd-4a0e-b6a9-55000397a332 tempest-VolumesListTestJSON-869214956 None] Lock "cinder-82934d02-ec14-4812-9d1c-3c878fe0616c-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:00 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6a3ea380-25ba-4986-9213-4232b66afa6d" returned: 0 in 0.531s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6a3ea380-25ba-4986-9213-4232b66afa6d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:00 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6a3ea380-25ba-4986-9213-4232b66afa6d Apr 15 10:13:00 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:00 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf" returned: 0 in 0.527s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:00 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf Apr 15 10:13:00 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:01 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6a3ea380-25ba-4986-9213-4232b66afa6d" returned: 0 in 0.421s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Lock "cinder-quobyte-6a3ea380-25ba-4986-9213-4232b66afa6d" released by "delete_volume" :: held 0.975s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Created reservations ['727f8fe9-ca13-4277-a9df-bedd8be91098', 'ac5d6057-69a7-4b98-b0e8-b51a3aeefb34', '32c164ab-e054-4e45-9790-75ddc04b52f4', '624efd28-770d-4024-bbd0-514bde5a368d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:01 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f78b475d-9996-4cfa-a595-e7c1946a7cbf" returned: 0 in 0.439s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Lock "cinder-quobyte-f78b475d-9996-4cfa-a595-e7c1946a7cbf" released by "delete_volume" :: held 1.002s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:01 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:13:01 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Created reservations ['632d4baf-ee8d-40aa-ac1c-c83c9731cb5e', '5cda5d0c-7b1d-4b2b-9bb2-36214a063147', 'd219fe04-cbe6-4d74-85bd-ba085c9bc640', 'ce2c280e-0ef8-4374-b3c3-30b33cf74987'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:01 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:13:01 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:01 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.411s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Deleted volume successfully. Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7f561b67-2797-4897-98f9-f2bcdb11928c tempest-VolumesListTestJSON-869214956 None] Lock "cinder-6a3ea380-25ba-4986-9213-4232b66afa6d-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:01 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.409s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Deleted volume successfully. Apr 15 10:13:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0d095609-2190-4cff-ae5d-107e05a94d4c tempest-VolumesServicesTestJSON-2023444933 None] Lock "cinder-f78b475d-9996-4cfa-a595-e7c1946a7cbf-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Flow 'volume_create_manager' (877f0648-75af-4486-9015-bf5958454ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de57ceb4-f374-4f2f-99be-bcf573301f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de57ceb4-f374-4f2f-99be-bcf573301f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1762335881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda6aa78-bb8d-407b-ae48-3de8e0531d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf3e18dbb2d48bd8409d7cc1f1ad831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:04Z,use_quota=True,user_id='0d4edc94d22e4e7c8846d2ad5a9940d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0ea5ee-7c10-4d57-907c-3509e6173ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0ea5ee-7c10-4d57-907c-3509e6173ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a92f76-94ff-4074-b775-b58851bed01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a92f76-94ff-4074-b775-b58851bed01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bda6aa78-bb8d-407b-ae48-3de8e0531d05', 'volume_name': 'volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ae08a1-f4fe-48c2-a604-e815ed6f769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ae08a1-f4fe-48c2-a604-e815ed6f769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6dbf900-eba0-49be-a4ad-a0a40652fe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Volume bda6aa78-bb8d-407b-ae48-3de8e0531d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05', 'volume_size': 1} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1762335881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda6aa78-bb8d-407b-ae48-3de8e0531d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf3e18dbb2d48bd8409d7cc1f1ad831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:04Z,use_quota=True,user_id='0d4edc94d22e4e7c8846d2ad5a9940d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Creating volume bda6aa78-bb8d-407b-ae48-3de8e0531d05 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:04 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:04 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05 1073741824 Apr 15 10:13:04 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Flow 'volume_create_manager' (d385bbc0-898c-46c7-9a61-061febbf3fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91ca009-0ef9-485c-9598-b082b1d0dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91ca009-0ef9-485c-9598-b082b1d0dce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-519544396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf3e18dbb2d48bd8409d7cc1f1ad831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:04Z,use_quota=True,user_id='0d4edc94d22e4e7c8846d2ad5a9940d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d8ad5b-5ce2-4d41-9439-4682e9b0036b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d8ad5b-5ce2-4d41-9439-4682e9b0036b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86e7a0a-e5f1-4b77-998a-008836c5969c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86e7a0a-e5f1-4b77-998a-008836c5969c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65', 'volume_name': 'volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379fa28b-1b51-454a-934c-b4bb2fd57b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379fa28b-1b51-454a-934c-b4bb2fd57b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86bbcd15-0dcc-4712-9fdb-d1e204513e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Volume 2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65', 'volume_size': 1} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Flow 'volume_create_manager' (51714384-6c4f-4a78-b6a8-d7d9461cb1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1018dde5-e1b4-4630-be0f-c619022ea047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1018dde5-e1b4-4630-be0f-c619022ea047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1593861207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824eead8-b388-43fb-8ab4-38f94ada4a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf3e18dbb2d48bd8409d7cc1f1ad831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:05Z,use_quota=True,user_id='0d4edc94d22e4e7c8846d2ad5a9940d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ab2309-0d0d-4eab-b521-0995065e925e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ab2309-0d0d-4eab-b521-0995065e925e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6de3c9-08aa-477d-b705-1618004de70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6de3c9-08aa-477d-b705-1618004de70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '824eead8-b388-43fb-8ab4-38f94ada4a12', 'volume_name': 'volume-824eead8-b388-43fb-8ab4-38f94ada4a12', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcd25c6-16bb-43fa-bb37-ce24d29e3886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcd25c6-16bb-43fa-bb37-ce24d29e3886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c8124f-abe5-4d4d-ab48-258754f40659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Volume 824eead8-b388-43fb-8ab4-38f94ada4a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-824eead8-b388-43fb-8ab4-38f94ada4a12', 'volume_size': 1} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=174,cinder:UPDATE=209,cinder:INSERT=60,cinder:DELETE=13 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=156,cinder:UPDATE=212,cinder:INSERT=48,cinder:DELETE=21 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Flow 'volume_create_manager' (5706d470-1371-4bf3-9b24-9c0c9ef1d864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254fde1d-20db-471f-84cb-20882fa4d9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254fde1d-20db-471f-84cb-20882fa4d9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1017419553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c41916-19b1-4594-aa7d-9510671931b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf3e18dbb2d48bd8409d7cc1f1ad831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:05Z,use_quota=True,user_id='0d4edc94d22e4e7c8846d2ad5a9940d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc19195-2356-4fd1-8949-e8d21bca283f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc19195-2356-4fd1-8949-e8d21bca283f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0c5b8d-af2d-44d7-b4b1-2095dded590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0c5b8d-af2d-44d7-b4b1-2095dded590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c41916-19b1-4594-aa7d-9510671931b3', 'volume_name': 'volume-54c41916-19b1-4594-aa7d-9510671931b3', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5dd54c9-4108-4074-b287-fc993af81d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5dd54c9-4108-4074-b287-fc993af81d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20db9e4e-1e09-4c44-aa45-0255a4041348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Volume 54c41916-19b1-4594-aa7d-9510671931b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c41916-19b1-4594-aa7d-9510671931b3', 'volume_size': 1} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:04 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05 1073741824" returned: 0 in 0.652s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:04 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05 Apr 15 10:13:04 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Flow 'volume_create_manager' (b4f3c090-fb2b-41fa-a342-4426836d0006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e03ee9-6647-4f26-a0dc-57f8f8fe142d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e03ee9-6647-4f26-a0dc-57f8f8fe142d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-990140315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96f005d-cf5a-4bed-b177-858cbd47ea24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf3e18dbb2d48bd8409d7cc1f1ad831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:05Z,use_quota=True,user_id='0d4edc94d22e4e7c8846d2ad5a9940d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9334bd3d-0d67-47ff-877c-7f9f1dac4e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9334bd3d-0d67-47ff-877c-7f9f1dac4e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a548aca6-63a0-42e4-8478-0b2d5be4af5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a548aca6-63a0-42e4-8478-0b2d5be4af5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96f005d-cf5a-4bed-b177-858cbd47ea24', 'volume_name': 'volume-e96f005d-cf5a-4bed-b177-858cbd47ea24', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ff68c2-3d9d-41cb-b1ff-08d5c9b04024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ff68c2-3d9d-41cb-b1ff-08d5c9b04024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4385120-20e0-417d-9d55-6d5fd8a51971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:05 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Volume e96f005d-cf5a-4bed-b177-858cbd47ea24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96f005d-cf5a-4bed-b177-858cbd47ea24', 'volume_size': 1} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:05 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05" returned: 0 in 0.447s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.927s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-519544396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf3e18dbb2d48bd8409d7cc1f1ad831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:04Z,use_quota=True,user_id='0d4edc94d22e4e7c8846d2ad5a9940d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Creating volume 2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:05 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6dbf900-eba0-49be-a4ad-a0a40652fe71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4e0203-0227-47c5-a92b-18bfd0dc9218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:05 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65 1073741824 Apr 15 10:13:05 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:05 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Volume volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05 (bda6aa78-bb8d-407b-ae48-3de8e0531d05): created successfully Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4e0203-0227-47c5-a92b-18bfd0dc9218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Flow 'volume_create_manager' (877f0648-75af-4486-9015-bf5958454ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:05 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7b01a202-578a-48c8-b615-8b55ea821195 tempest-CreateVolumesFromImageTest-1957377617 None] Created volume successfully. Apr 15 10:13:05 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65 1073741824" returned: 0 in 0.536s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:05 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65 Apr 15 10:13:05 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:06 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65" returned: 0 in 0.459s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.758s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1593861207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824eead8-b388-43fb-8ab4-38f94ada4a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf3e18dbb2d48bd8409d7cc1f1ad831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:05Z,use_quota=True,user_id='0d4edc94d22e4e7c8846d2ad5a9940d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Creating volume 824eead8-b388-43fb-8ab4-38f94ada4a12 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:06 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-824eead8-b388-43fb-8ab4-38f94ada4a12 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86bbcd15-0dcc-4712-9fdb-d1e204513e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7598dfa2-2a19-4aed-a2e5-a9d3d2f901cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:06 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-824eead8-b388-43fb-8ab4-38f94ada4a12 1073741824 Apr 15 10:13:06 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:06 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Volume volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65 (2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65): created successfully Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7598dfa2-2a19-4aed-a2e5-a9d3d2f901cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Flow 'volume_create_manager' (d385bbc0-898c-46c7-9a61-061febbf3fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-43e6825e-61b2-440e-8833-22e711c1b408 tempest-CreateVolumesFromImageTest-1957377617 None] Created volume successfully. Apr 15 10:13:06 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-824eead8-b388-43fb-8ab4-38f94ada4a12 1073741824" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-824eead8-b388-43fb-8ab4-38f94ada4a12 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:07 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-824eead8-b388-43fb-8ab4-38f94ada4a12 Apr 15 10:13:07 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:07 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-824eead8-b388-43fb-8ab4-38f94ada4a12" returned: 0 in 0.438s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.545s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1017419553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c41916-19b1-4594-aa7d-9510671931b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf3e18dbb2d48bd8409d7cc1f1ad831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:05Z,use_quota=True,user_id='0d4edc94d22e4e7c8846d2ad5a9940d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Creating volume 54c41916-19b1-4594-aa7d-9510671931b3 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:07 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-54c41916-19b1-4594-aa7d-9510671931b3 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c8124f-abe5-4d4d-ab48-258754f40659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-824eead8-b388-43fb-8ab4-38f94ada4a12', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:07 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-54c41916-19b1-4594-aa7d-9510671931b3 1073741824 Apr 15 10:13:07 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51b286e-4704-4131-897b-80fbbb05c831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Volume volume-824eead8-b388-43fb-8ab4-38f94ada4a12 (824eead8-b388-43fb-8ab4-38f94ada4a12): created successfully Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51b286e-4704-4131-897b-80fbbb05c831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Flow 'volume_create_manager' (51714384-6c4f-4a78-b6a8-d7d9461cb1e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e33d3046-6b93-4f93-a9df-24151909e71b tempest-CreateVolumesFromImageTest-1957377617 None] Created volume successfully. Apr 15 10:13:08 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-54c41916-19b1-4594-aa7d-9510671931b3 1073741824" returned: 0 in 0.612s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-54c41916-19b1-4594-aa7d-9510671931b3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:08 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-54c41916-19b1-4594-aa7d-9510671931b3 Apr 15 10:13:08 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:08 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-54c41916-19b1-4594-aa7d-9510671931b3" returned: 0 in 0.451s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.439s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-990140315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96f005d-cf5a-4bed-b177-858cbd47ea24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf3e18dbb2d48bd8409d7cc1f1ad831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:05Z,use_quota=True,user_id='0d4edc94d22e4e7c8846d2ad5a9940d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Creating volume e96f005d-cf5a-4bed-b177-858cbd47ea24 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:08 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e96f005d-cf5a-4bed-b177-858cbd47ea24 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20db9e4e-1e09-4c44-aa45-0255a4041348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c41916-19b1-4594-aa7d-9510671931b3', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada48b22-758e-49f8-a839-286df432d5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:08 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e96f005d-cf5a-4bed-b177-858cbd47ea24 1073741824 Apr 15 10:13:08 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:08 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Volume volume-54c41916-19b1-4594-aa7d-9510671931b3 (54c41916-19b1-4594-aa7d-9510671931b3): created successfully Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada48b22-758e-49f8-a839-286df432d5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Flow 'volume_create_manager' (5706d470-1371-4bf3-9b24-9c0c9ef1d864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-99cf671d-f1db-43fb-a4a5-a158ee444d21 tempest-CreateVolumesFromImageTest-1957377617 None] Created volume successfully. Apr 15 10:13:09 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e96f005d-cf5a-4bed-b177-858cbd47ea24 1073741824" returned: 0 in 0.577s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e96f005d-cf5a-4bed-b177-858cbd47ea24 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:09 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e96f005d-cf5a-4bed-b177-858cbd47ea24 Apr 15 10:13:09 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:09 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e96f005d-cf5a-4bed-b177-858cbd47ea24" returned: 0 in 0.477s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4385120-20e0-417d-9d55-6d5fd8a51971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96f005d-cf5a-4bed-b177-858cbd47ea24', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68422c5b-c646-4990-9969-6a1b8d47a796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:09 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Volume volume-e96f005d-cf5a-4bed-b177-858cbd47ea24 (e96f005d-cf5a-4bed-b177-858cbd47ea24): created successfully Apr 15 10:13:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68422c5b-c646-4990-9969-6a1b8d47a796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Flow 'volume_create_manager' (b4f3c090-fb2b-41fa-a342-4426836d0006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6a94f4db-f655-4647-9881-9805510c2ae9 tempest-CreateVolumesFromImageTest-1957377617 None] Created volume successfully. Apr 15 10:13:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "cinder-e96f005d-cf5a-4bed-b177-858cbd47ea24-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-e96f005d-cf5a-4bed-b177-858cbd47ea24-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "cinder-quobyte-e96f005d-cf5a-4bed-b177-858cbd47ea24" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-quobyte-e96f005d-cf5a-4bed-b177-858cbd47ea24" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef14dc8f-f7a3-4db6-93a9-8962f24250d3]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e96f005d-cf5a-4bed-b177-858cbd47ea24 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:10 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e96f005d-cf5a-4bed-b177-858cbd47ea24 Apr 15 10:13:10 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:11 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e96f005d-cf5a-4bed-b177-858cbd47ea24" returned: 0 in 0.564s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e96f005d-cf5a-4bed-b177-858cbd47ea24 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:11 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e96f005d-cf5a-4bed-b177-858cbd47ea24 Apr 15 10:13:11 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:11 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e96f005d-cf5a-4bed-b177-858cbd47ea24" returned: 0 in 0.461s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-quobyte-e96f005d-cf5a-4bed-b177-858cbd47ea24" released by "delete_volume" :: held 1.076s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:11 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Created reservations ['1341140e-84dd-4037-a698-158a289083a4', 'da5899e7-398e-4c3b-bcd1-e1af742da6ec', '1322ca84-5e52-4c92-91a2-8c583462ba58', '10cf1c2e-13de-4867-b317-a8dbf3c6e314'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:11 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:13:11 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Flow 'volume_create_manager' (e8526e43-3127-4b56-929e-53828515adc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2119fc96-9fa0-477f-9b48-0ded7ab785bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2119fc96-9fa0-477f-9b48-0ded7ab785bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-246594622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9b5072-3d93-4ad4-ba03-c4e868b4332d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7f53765ff8e4d199beda8d37e5de3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:12Z,use_quota=True,user_id='b0bcdf31557c4450ad66c7edc9b9269d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767981a9-9e0d-42fb-9378-685c38f8683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767981a9-9e0d-42fb-9378-685c38f8683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98f15fb-5ee8-4140-adea-8e6136547201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98f15fb-5ee8-4140-adea-8e6136547201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b9b5072-3d93-4ad4-ba03-c4e868b4332d', 'volume_name': 'volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350732cd-fd51-4351-a383-a5ce019e3cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350732cd-fd51-4351-a383-a5ce019e3cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbef424d-eba0-4dbd-a333-9ad5dbcad367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:12 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Volume 2b9b5072-3d93-4ad4-ba03-c4e868b4332d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d', 'volume_size': 1} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-246594622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9b5072-3d93-4ad4-ba03-c4e868b4332d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7f53765ff8e4d199beda8d37e5de3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:12Z,use_quota=True,user_id='b0bcdf31557c4450ad66c7edc9b9269d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Creating volume 2b9b5072-3d93-4ad4-ba03-c4e868b4332d {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:12 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:12 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d 1073741824 Apr 15 10:13:12 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:12 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.439s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:12 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Deleted volume successfully. Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e4401b7c-b32b-4d4e-acb2-d8d96e8a7879 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-e96f005d-cf5a-4bed-b177-858cbd47ea24-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:12 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d 1073741824" returned: 0 in 0.461s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:12 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d Apr 15 10:13:12 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "cinder-54c41916-19b1-4594-aa7d-9510671931b3-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-54c41916-19b1-4594-aa7d-9510671931b3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "cinder-quobyte-54c41916-19b1-4594-aa7d-9510671931b3" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-quobyte-54c41916-19b1-4594-aa7d-9510671931b3" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8fe0f2-b137-4309-9425-82888df4c0f4]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-54c41916-19b1-4594-aa7d-9510671931b3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:12 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-54c41916-19b1-4594-aa7d-9510671931b3 Apr 15 10:13:12 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:13 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d" returned: 0 in 0.433s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbef424d-eba0-4dbd-a333-9ad5dbcad367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68754602-af53-45f6-b9cc-37ec2f22ee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:13 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Volume volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d (2b9b5072-3d93-4ad4-ba03-c4e868b4332d): created successfully Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68754602-af53-45f6-b9cc-37ec2f22ee10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Flow 'volume_create_manager' (e8526e43-3127-4b56-929e-53828515adc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:13 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-33a5a984-c622-42c3-b179-a9b60968e2fe tempest-AbsoluteLimitsTests-1467677896 None] Created volume successfully. Apr 15 10:13:13 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-54c41916-19b1-4594-aa7d-9510671931b3" returned: 0 in 0.474s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-54c41916-19b1-4594-aa7d-9510671931b3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:13 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-54c41916-19b1-4594-aa7d-9510671931b3 Apr 15 10:13:13 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:13 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-54c41916-19b1-4594-aa7d-9510671931b3" returned: 0 in 0.396s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-quobyte-54c41916-19b1-4594-aa7d-9510671931b3" released by "delete_volume" :: held 0.894s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Created reservations ['a8d404c5-3806-4082-947e-7d6c5ecc62fc', '5085a67a-b6f3-4904-9e89-e9cc82b868bd', 'a9c0050b-026f-432c-a7a5-d0c941254d1c', '5c0c5869-9a71-4887-855f-5d5e1ad89647'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:13 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:13:13 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "cinder-824eead8-b388-43fb-8ab4-38f94ada4a12-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-824eead8-b388-43fb-8ab4-38f94ada4a12-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "cinder-quobyte-824eead8-b388-43fb-8ab4-38f94ada4a12" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-quobyte-824eead8-b388-43fb-8ab4-38f94ada4a12" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[209b433a-ecb8-43db-b192-b1dbce19bfed]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-824eead8-b388-43fb-8ab4-38f94ada4a12 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:13 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-824eead8-b388-43fb-8ab4-38f94ada4a12 Apr 15 10:13:13 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:14 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.442s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Deleted volume successfully. Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4ddaddde-58f0-41fd-8054-6e8b1ba5a2b8 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-54c41916-19b1-4594-aa7d-9510671931b3-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:14 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Acquiring lock "cinder-2b9b5072-3d93-4ad4-ba03-c4e868b4332d-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-824eead8-b388-43fb-8ab4-38f94ada4a12" returned: 0 in 0.499s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-824eead8-b388-43fb-8ab4-38f94ada4a12 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Lock "cinder-2b9b5072-3d93-4ad4-ba03-c4e868b4332d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:14 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-824eead8-b388-43fb-8ab4-38f94ada4a12 Apr 15 10:13:14 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Acquiring lock "cinder-quobyte-2b9b5072-3d93-4ad4-ba03-c4e868b4332d" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Lock "cinder-quobyte-2b9b5072-3d93-4ad4-ba03-c4e868b4332d" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[84723651-fd8a-4282-b05c-2233a15ab76e]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:14 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d Apr 15 10:13:14 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:14 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-824eead8-b388-43fb-8ab4-38f94ada4a12" returned: 0 in 0.417s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-quobyte-824eead8-b388-43fb-8ab4-38f94ada4a12" released by "delete_volume" :: held 0.943s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Created reservations ['b8a8bedb-7d38-4dbd-b060-4236d17925cc', '33557691-00bd-47bc-b9d7-9aa7344f7c26', 'dedda106-d1dc-4395-8b54-57a90257ae5a', '24e00432-c99e-4100-834c-d6f874a9a5f7'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:14 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:13:14 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "cinder-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:15 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d" returned: 0 in 0.511s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:15 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d Apr 15 10:13:15 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "cinder-quobyte-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-quobyte-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e5938f-c7f7-4957-a235-3d9051e4f59f]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:15 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65 Apr 15 10:13:15 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:15 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.432s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Deleted volume successfully. Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f5697961-0826-4297-8ca2-e9f3c6afd815 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-824eead8-b388-43fb-8ab4-38f94ada4a12-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:15 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2b9b5072-3d93-4ad4-ba03-c4e868b4332d" returned: 0 in 0.439s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Lock "cinder-quobyte-2b9b5072-3d93-4ad4-ba03-c4e868b4332d" released by "delete_volume" :: held 0.975s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Created reservations ['bf61ff2a-aa63-4b74-ac10-aeec640095d3', '57f865a6-9e80-44f3-afa6-e387d983f4b2', '1db2550a-a3a4-4b4b-90a9-23a149992434', '9345eba6-e05f-49a0-8314-36182ac12e1f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:15 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65" returned: 0 in 0.509s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:15 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65 Apr 15 10:13:15 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:15 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:13:15 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:15 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65" returned: 0 in 0.416s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-quobyte-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65" released by "delete_volume" :: held 0.946s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Created reservations ['811ae9f8-8f3b-497e-b2f1-f2f920dbf92d', 'fe97e158-516f-4ec0-89e8-d9ac08eedd38', 'e08d8e9b-f702-48b4-a3b0-aedd07867fa7', '67f2ca3c-82a7-494f-a752-0cacc34c55f9'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:16 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.458s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Deleted volume successfully. Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-918ba8d4-3c6e-40f2-a057-dd1ecd3e5622 tempest-AbsoluteLimitsTests-1467677896 None] Lock "cinder-2b9b5072-3d93-4ad4-ba03-c4e868b4332d-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:16 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:13:16 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "cinder-bda6aa78-bb8d-407b-ae48-3de8e0531d05-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-bda6aa78-bb8d-407b-ae48-3de8e0531d05-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "cinder-quobyte-bda6aa78-bb8d-407b-ae48-3de8e0531d05" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-quobyte-bda6aa78-bb8d-407b-ae48-3de8e0531d05" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[754f47a1-d129-4fcf-a94e-7afd1b4953a3]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:16 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05 Apr 15 10:13:16 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:16 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.444s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Deleted volume successfully. Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8b0d7dcf-df12-4a0b-902d-27a461c981c7 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-2dfc9aca-5ec1-4cca-b6b6-58f19e0d3b65-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:16 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05" returned: 0 in 0.509s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:16 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05 Apr 15 10:13:16 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:17 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-bda6aa78-bb8d-407b-ae48-3de8e0531d05" returned: 0 in 0.454s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-quobyte-bda6aa78-bb8d-407b-ae48-3de8e0531d05" released by "delete_volume" :: held 0.988s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:17 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Created reservations ['92cde52f-5575-4713-a81e-ffdf674ec248', '696c4f7b-74b9-4b63-b317-834b3f2057ed', 'b92acd39-9f96-4cd1-a639-1a29de2bd75c', '91505ffd-f958-4cf6-a9dd-0eaed0c76c4c'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:17 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:13:17 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:17 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.502s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:17 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Deleted volume successfully. Apr 15 10:13:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-497a8173-ef2d-4f17-b0e4-6fecf4279e77 tempest-CreateVolumesFromImageTest-1957377617 None] Lock "cinder-bda6aa78-bb8d-407b-ae48-3de8e0531d05-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:20 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Flow 'volume_create_manager' (9c8c922a-2cf0-4bb8-a143-d1046d0390cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9676d09c-e9f3-4b89-af3a-c989a37b09b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9676d09c-e9f3-4b89-af3a-c989a37b09b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-25895056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef79deb7-2d33-4c21-97fe-443c00a878ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c6840e84e941c2be95e4857a33d3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:21Z,use_quota=True,user_id='a9637dc682a64a21880aa5a0c2505e4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017e675b-f2fc-4ca0-a453-8b8cd3b3d99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017e675b-f2fc-4ca0-a453-8b8cd3b3d99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66019cf6-0019-418c-b671-30298c591775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66019cf6-0019-418c-b671-30298c591775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef79deb7-2d33-4c21-97fe-443c00a878ef', 'volume_name': 'volume-ef79deb7-2d33-4c21-97fe-443c00a878ef', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2ad9a9-fb8d-426a-8227-d86a2d36c14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2ad9a9-fb8d-426a-8227-d86a2d36c14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37579d45-b66c-4261-a73b-3e661069858b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:21 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Volume ef79deb7-2d33-4c21-97fe-443c00a878ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef79deb7-2d33-4c21-97fe-443c00a878ef', 'volume_size': 1} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-25895056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef79deb7-2d33-4c21-97fe-443c00a878ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c6840e84e941c2be95e4857a33d3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:21Z,use_quota=True,user_id='a9637dc682a64a21880aa5a0c2505e4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Creating volume ef79deb7-2d33-4c21-97fe-443c00a878ef {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:21 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ef79deb7-2d33-4c21-97fe-443c00a878ef 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:21 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ef79deb7-2d33-4c21-97fe-443c00a878ef 1073741824 Apr 15 10:13:21 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:21 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ef79deb7-2d33-4c21-97fe-443c00a878ef 1073741824" returned: 0 in 0.494s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ef79deb7-2d33-4c21-97fe-443c00a878ef {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:21 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ef79deb7-2d33-4c21-97fe-443c00a878ef Apr 15 10:13:21 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:21 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ef79deb7-2d33-4c21-97fe-443c00a878ef" returned: 0 in 0.429s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37579d45-b66c-4261-a73b-3e661069858b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef79deb7-2d33-4c21-97fe-443c00a878ef', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c6623e-9f1e-47a3-aac9-a42be5bfe45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:22 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Volume volume-ef79deb7-2d33-4c21-97fe-443c00a878ef (ef79deb7-2d33-4c21-97fe-443c00a878ef): created successfully Apr 15 10:13:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c6623e-9f1e-47a3-aac9-a42be5bfe45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Flow 'volume_create_manager' (9c8c922a-2cf0-4bb8-a143-d1046d0390cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c22c5b9f-28cd-47d8-a6bd-c428d264353c tempest-VolumesNegativeTest-918982227 None] Created volume successfully. Apr 15 10:13:32 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=38,cinder:UPDATE=70,cinder:INSERT=10,cinder:DELETE=5 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:13:32 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=65,cinder:SELECT=44,cinder:DELETE=8,cinder:INSERT=21 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:13:37 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:13:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:37 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:13:37 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:38 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.389s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:38 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Acquiring lock "cinder-ef79deb7-2d33-4c21-97fe-443c00a878ef-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Lock "cinder-ef79deb7-2d33-4c21-97fe-443c00a878ef-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Acquiring lock "cinder-quobyte-ef79deb7-2d33-4c21-97fe-443c00a878ef" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Lock "cinder-quobyte-ef79deb7-2d33-4c21-97fe-443c00a878ef" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:46 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82e0436-7000-4844-a5b1-67157ad0f394]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ef79deb7-2d33-4c21-97fe-443c00a878ef {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:47 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ef79deb7-2d33-4c21-97fe-443c00a878ef Apr 15 10:13:47 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:47 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ef79deb7-2d33-4c21-97fe-443c00a878ef" returned: 0 in 0.439s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ef79deb7-2d33-4c21-97fe-443c00a878ef {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:47 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ef79deb7-2d33-4c21-97fe-443c00a878ef Apr 15 10:13:47 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:47 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ef79deb7-2d33-4c21-97fe-443c00a878ef" returned: 0 in 0.386s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Lock "cinder-quobyte-ef79deb7-2d33-4c21-97fe-443c00a878ef" released by "delete_volume" :: held 0.854s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:47 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Created reservations ['615b6f1e-71b1-4d39-9e52-47c5e607d146', 'b0dba4ad-42f1-46f6-b3b6-22a63d2e663f', '402a8b8a-7def-4e67-a8fe-c011ee23f618', 'bf167360-5c6f-403c-bb93-5cf7b94a6eb1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:47 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:13:47 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:48 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.428s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:48 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Deleted volume successfully. Apr 15 10:13:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bec6643c-8676-49b6-aebd-5577b1c5a357 tempest-VolumesNegativeTest-918982227 None] Lock "cinder-ef79deb7-2d33-4c21-97fe-443c00a878ef-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Flow 'volume_create_manager' (adb899fc-a09e-4bb5-9d84-fb130cf3966d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e385507-2ba9-4bbb-8724-537f55361cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e385507-2ba9-4bbb-8724-537f55361cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1589608904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081b2f9f-e298-4721-ac88-4d86d943c6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9558223d38384563a47f53cda3db4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:55Z,use_quota=True,user_id='0fff312526b2421fa17ffea17505d315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c797a8e5-5bc3-40fe-8b90-e6f1a0f14b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c797a8e5-5bc3-40fe-8b90-e6f1a0f14b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf79cda3-1fa6-4d4a-a118-e490ca939541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf79cda3-1fa6-4d4a-a118-e490ca939541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '081b2f9f-e298-4721-ac88-4d86d943c6bd', 'volume_name': 'volume-081b2f9f-e298-4721-ac88-4d86d943c6bd', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0235a58c-ae85-47c6-9a04-334303da8ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0235a58c-ae85-47c6-9a04-334303da8ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d86138-7981-40ab-b719-35e38af95870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:54 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Volume 081b2f9f-e298-4721-ac88-4d86d943c6bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-081b2f9f-e298-4721-ac88-4d86d943c6bd', 'volume_size': 1} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1589608904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081b2f9f-e298-4721-ac88-4d86d943c6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9558223d38384563a47f53cda3db4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:55Z,use_quota=True,user_id='0fff312526b2421fa17ffea17505d315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Creating volume 081b2f9f-e298-4721-ac88-4d86d943c6bd {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:54 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:13:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:54 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd 1073741824 Apr 15 10:13:54 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:55 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd 1073741824" returned: 0 in 0.519s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:55 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd Apr 15 10:13:55 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:55 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd" returned: 0 in 0.440s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d86138-7981-40ab-b719-35e38af95870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-081b2f9f-e298-4721-ac88-4d86d943c6bd', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccab5a6-583e-43c9-8e9c-389048c5f50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:55 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Volume volume-081b2f9f-e298-4721-ac88-4d86d943c6bd (081b2f9f-e298-4721-ac88-4d86d943c6bd): created successfully Apr 15 10:13:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccab5a6-583e-43c9-8e9c-389048c5f50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Flow 'volume_create_manager' (adb899fc-a09e-4bb5-9d84-fb130cf3966d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:55 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-674f922c-d119-43d9-a2ee-efbf2e664d35 tempest-VolumesSnapshotTestJSON-2122450131 None] Created volume successfully. Apr 15 10:13:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] Creating offline snapshot 8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 of volume 081b2f9f-e298-4721-ac88-4d86d943c6bd {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:13:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b214a8-949c-48b2-a381-c15676e67a88]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:57 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd Apr 15 10:13:57 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:57 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd" returned: 0 in 0.501s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:57 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 1G Apr 15 10:13:57 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:58 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 1G" returned: 0 in 0.474s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-081b2f9f-e298-4721-ac88-4d86d943c6bd -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:58 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-081b2f9f-e298-4721-ac88-4d86d943c6bd -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 Apr 15 10:13:58 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:58 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-081b2f9f-e298-4721-ac88-4d86d943c6bd -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61" returned: 0 in 0.446s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:58 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 is being set with open permissions: ugo+rw Apr 15 10:13:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:58 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 Apr 15 10:13:58 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:58 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61" returned: 0 in 0.470s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:58 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.info Apr 15 10:13:58 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:59 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.info" returned: 0 in 0.400s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:59 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.info is being set with open permissions: ugo+rw Apr 15 10:13:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:59 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.info Apr 15 10:13:59 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:59 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.info" returned: 0 in 0.465s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.849s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b222075e-1119-4860-8261-a392034a304c tempest-VolumesSnapshotTestJSON-2122450131 None] Create snapshot completed successfully Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-8aa0b317-d0db-4b10-b5b5-2ef5e888cd61-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-8aa0b317-d0db-4b10-b5b5-2ef5e888cd61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-081b2f9f-e298-4721-ac88-4d86d943c6bd" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-081b2f9f-e298-4721-ac88-4d86d943c6bd" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-8aa0b317-d0db-4b10-b5b5-2ef5e888cd61" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-8aa0b317-d0db-4b10-b5b5-2ef5e888cd61" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Deleting offline snapshot 8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 of volume 081b2f9f-e298-4721-ac88-4d86d943c6bd {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] snapshot_file for this snap is: volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[63679de6-9c90-47f3-ad84-a2435cdce949]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:00 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 Apr 15 10:14:00 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:00 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61" returned: 0 in 0.483s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-081b2f9f-e298-4721-ac88-4d86d943c6bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4b24f1-5c6b-40a2-b133-f0b33cc8d21f]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:00 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd Apr 15 10:14:00 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:01 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd" returned: 0 in 0.494s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:01 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 Apr 15 10:14:01 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:01 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61" returned: 0 in 0.481s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:01 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61 Apr 15 10:14:01 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:02 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd.8aa0b317-d0db-4b10-b5b5-2ef5e888cd61" returned: 0 in 0.412s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-8aa0b317-d0db-4b10-b5b5-2ef5e888cd61" released by "_delete_snapshot" :: held 1.936s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-081b2f9f-e298-4721-ac88-4d86d943c6bd" released by "delete_snapshot" :: held 1.947s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Created reservations ['db2389f0-28b3-4973-9d3c-8d5ffba186e0', 'c8687811-d960-4be9-82bf-e26a3a72403a', 'c638475b-9a98-4bcd-9b1e-39aa2c36fe66', '06c4f453-a93a-4d3d-abe6-75de7baab57a'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:02 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Delete snapshot completed successfully. Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-88df1db3-a538-484c-9ea7-3c0bc57f4c7b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-8aa0b317-d0db-4b10-b5b5-2ef5e888cd61-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Flow 'volume_create_manager' (820da2fc-9c56-4266-8fef-e2c4df8da83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c96deff-5676-40f3-b273-3f662e9f154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c96deff-5676-40f3-b273-3f662e9f154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1354683853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b9cb46-0ebc-4c33-a649-57219cbc3ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9558223d38384563a47f53cda3db4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:03Z,use_quota=True,user_id='0fff312526b2421fa17ffea17505d315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03090937-cf47-44e9-80bd-ceb39931adc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03090937-cf47-44e9-80bd-ceb39931adc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d86eea-c8e7-43af-9c67-6c5d7abcff20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d86eea-c8e7-43af-9c67-6c5d7abcff20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b9cb46-0ebc-4c33-a649-57219cbc3ecb', 'volume_name': 'volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c20b05c-a431-491e-a442-188f158985c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c20b05c-a431-491e-a442-188f158985c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2c2df3-57cf-4cc1-ba58-b844935c21e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:02 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Volume 51b9cb46-0ebc-4c33-a649-57219cbc3ecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb', 'volume_size': 1} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1354683853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b9cb46-0ebc-4c33-a649-57219cbc3ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9558223d38384563a47f53cda3db4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:03Z,use_quota=True,user_id='0fff312526b2421fa17ffea17505d315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Creating volume 51b9cb46-0ebc-4c33-a649-57219cbc3ecb {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:02 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:14:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:02 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb 1073741824 Apr 15 10:14:02 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:03 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb 1073741824" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:03 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb Apr 15 10:14:03 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:03 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb" returned: 0 in 0.423s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2c2df3-57cf-4cc1-ba58-b844935c21e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd31832d-c4e4-4e67-b5bf-3cc606a29604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:03 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Volume volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb (51b9cb46-0ebc-4c33-a649-57219cbc3ecb): created successfully Apr 15 10:14:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd31832d-c4e4-4e67-b5bf-3cc606a29604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Flow 'volume_create_manager' (820da2fc-9c56-4266-8fef-e2c4df8da83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:03 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d56a3c47-4b77-4fd5-be4d-63278cd6319d tempest-VolumesSnapshotTestJSON-2122450131 None] Created volume successfully. Apr 15 10:14:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] Creating offline snapshot 034432a5-be80-4d7a-86c3-28af31be1d52 of volume 51b9cb46-0ebc-4c33-a649-57219cbc3ecb {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:14:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1513adf8-32c1-466c-8247-1429bde89013]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:04 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb Apr 15 10:14:04 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:05 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb" returned: 0 in 0.468s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:05 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 1G Apr 15 10:14:05 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:05 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 1G" returned: 0 in 0.450s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:05 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 Apr 15 10:14:05 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:06 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52" returned: 0 in 0.408s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:06 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 is being set with open permissions: ugo+rw Apr 15 10:14:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:06 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 Apr 15 10:14:06 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:06 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52" returned: 0 in 0.388s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:06 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.info Apr 15 10:14:06 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:06 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.info" returned: 0 in 0.402s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:07 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.info is being set with open permissions: ugo+rw Apr 15 10:14:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:07 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.info Apr 15 10:14:07 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:07 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.info" returned: 0 in 0.377s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.547s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0dbdb48b-1b93-4d84-a9c8-d76cc13d895d tempest-VolumesSnapshotTestJSON-2122450131 None] Create snapshot completed successfully Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Flow 'volume_create_manager' (e6a92f78-9c5b-4f85-8607-a348807f63d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7061fede-92ff-49f7-972e-e406626a8b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7061fede-92ff-49f7-972e-e406626a8b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2043845529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd87fe29-0639-440d-a231-7d560a7d2658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9558223d38384563a47f53cda3db4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=034432a5-be80-4d7a-86c3-28af31be1d52,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:08Z,use_quota=True,user_id='0fff312526b2421fa17ffea17505d315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b22e2d2-8776-4fcd-a713-5756466cca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b22e2d2-8776-4fcd-a713-5756466cca30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895c0a7b-d65d-4872-831e-7df4b612dcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895c0a7b-d65d-4872-831e-7df4b612dcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd87fe29-0639-440d-a231-7d560a7d2658', 'volume_name': 'volume-cd87fe29-0639-440d-a231-7d560a7d2658', 'volume_size': 2, 'snapshot_id': '034432a5-be80-4d7a-86c3-28af31be1d52'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3753f7f2-1cee-43ec-bf47-85806d23a3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3753f7f2-1cee-43ec-bf47-85806d23a3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b91b00-35ea-4880-92bc-c059d3707cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:08 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Volume cd87fe29-0639-440d-a231-7d560a7d2658: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd87fe29-0639-440d-a231-7d560a7d2658', 'volume_size': 2, 'snapshot_id': '034432a5-be80-4d7a-86c3-28af31be1d52'} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-034432a5-be80-4d7a-86c3-28af31be1d52-cd87fe29-0639-440d-a231-7d560a7d2658" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-034432a5-be80-4d7a-86c3-28af31be1d52-cd87fe29-0639-440d-a231-7d560a7d2658" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Creating volume cd87fe29-0639-440d-a231-7d560a7d2658 from snapshot 034432a5-be80-4d7a-86c3-28af31be1d52 {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-cd87fe29-0639-440d-a231-7d560a7d2658" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-cd87fe29-0639-440d-a231-7d560a7d2658" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] snapshot: 034432a5-be80-4d7a-86c3-28af31be1d52, volume: cd87fe29-0639-440d-a231-7d560a7d2658, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0b8907-8f30-446f-8334-f018eb209848]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:08 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 Apr 15 10:14:08 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:08 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52" returned: 0 in 0.446s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] will copy from snapshot at /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b6477d-991f-4913-99d6-a82866ef913a]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:08 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb Apr 15 10:14:08 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:09 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb" returned: 0 in 0.459s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:09 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Path /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:14:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:09 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658 Apr 15 10:14:09 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:11 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658" returned: 0 in 1.897s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:11 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e498afe1-f3e7-42e5-ae32-ed8c6af67bb4]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:11 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb Apr 15 10:14:11 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:11 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb" returned: 0 in 0.592s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:11 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb, size 1024.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:14:11 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Converted 1024.00 MB image at 539.48 MB/s Apr 15 10:14:11 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658 is being set with open permissions: ugo+rw Apr 15 10:14:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:11 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658 Apr 15 10:14:11 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:12 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658" returned: 0 in 0.393s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-cd87fe29-0639-440d-a231-7d560a7d2658" released by "_copy_volume_from_snapshot" :: held 3.840s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-034432a5-be80-4d7a-86c3-28af31be1d52-cd87fe29-0639-440d-a231-7d560a7d2658" released by "_create_volume_from_snapshot" :: held 3.859s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.867s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b91b00-35ea-4880-92bc-c059d3707cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd87fe29-0639-440d-a231-7d560a7d2658', 'volume_size': 2, 'snapshot_id': '034432a5-be80-4d7a-86c3-28af31be1d52'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22a0f57-cd9a-4da8-931b-7f8d9db5f3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:12 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Volume volume-cd87fe29-0639-440d-a231-7d560a7d2658 (cd87fe29-0639-440d-a231-7d560a7d2658): created successfully Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22a0f57-cd9a-4da8-931b-7f8d9db5f3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Flow 'volume_create_manager' (e6a92f78-9c5b-4f85-8607-a348807f63d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:12 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f6b9e128-343e-4727-bdac-f7d8e43b998b tempest-VolumesSnapshotTestJSON-2122450131 None] Created volume successfully. Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-cd87fe29-0639-440d-a231-7d560a7d2658-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-cd87fe29-0639-440d-a231-7d560a7d2658-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-cd87fe29-0639-440d-a231-7d560a7d2658" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-cd87fe29-0639-440d-a231-7d560a7d2658" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d710530-1ac0-43e8-996e-fc31301b9566]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:12 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658 Apr 15 10:14:12 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:13 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658" returned: 0 in 0.450s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:13 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658 Apr 15 10:14:13 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:13 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-cd87fe29-0639-440d-a231-7d560a7d2658" returned: 0 in 0.392s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-cd87fe29-0639-440d-a231-7d560a7d2658" released by "delete_volume" :: held 0.871s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Created reservations ['95ba17a6-11f4-477a-9efc-c4d2994b8d1c', '820cab38-59d2-469c-9a3c-809de2f2145b', '3f92aa4b-f0bc-4895-9ad7-6ad0c22496f8', 'a103c984-9cb8-489c-9bde-0be72bc5778c'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:13 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:14:13 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-034432a5-be80-4d7a-86c3-28af31be1d52-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-034432a5-be80-4d7a-86c3-28af31be1d52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-51b9cb46-0ebc-4c33-a649-57219cbc3ecb" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-51b9cb46-0ebc-4c33-a649-57219cbc3ecb" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-034432a5-be80-4d7a-86c3-28af31be1d52" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-034432a5-be80-4d7a-86c3-28af31be1d52" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Deleting offline snapshot 034432a5-be80-4d7a-86c3-28af31be1d52 of volume 51b9cb46-0ebc-4c33-a649-57219cbc3ecb {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] snapshot_file for this snap is: volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f448f6-8462-4a59-b693-4ea603c53e7d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:13 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 Apr 15 10:14:13 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:13 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.413s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:13 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:13 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Deleted volume successfully. Apr 15 10:14:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c47c04b5-7ee7-4905-bb66-f8170d298b2f tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-cd87fe29-0639-440d-a231-7d560a7d2658-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:14 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52" returned: 0 in 0.459s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c272de2f-96c2-42e6-9c1a-0909aa0157e8]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:14 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb Apr 15 10:14:14 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:14 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb" returned: 0 in 0.441s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:14 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 Apr 15 10:14:14 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:15 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52" returned: 0 in 0.420s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:15 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52 Apr 15 10:14:15 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:15 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb.034432a5-be80-4d7a-86c3-28af31be1d52" returned: 0 in 0.400s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-034432a5-be80-4d7a-86c3-28af31be1d52" released by "_delete_snapshot" :: held 1.776s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-51b9cb46-0ebc-4c33-a649-57219cbc3ecb" released by "delete_snapshot" :: held 1.788s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:15 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Created reservations ['2ff0d440-530c-49d0-b8f1-cf4f12cbab19', '0a1be58b-5078-4139-8593-2489aeec0b9e', 'be5c32a2-1272-4489-9469-9fb0c8c29a7f', '214f40dc-cb2f-4ece-9182-93f53f8b74b1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Delete snapshot completed successfully. Apr 15 10:14:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b97d71f1-1678-4e2d-84e1-3676aaaab6e4 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-034432a5-be80-4d7a-86c3-28af31be1d52-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-51b9cb46-0ebc-4c33-a649-57219cbc3ecb-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-51b9cb46-0ebc-4c33-a649-57219cbc3ecb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-51b9cb46-0ebc-4c33-a649-57219cbc3ecb" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-51b9cb46-0ebc-4c33-a649-57219cbc3ecb" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1d0455-fc5a-4863-bc42-f2a1b6185001]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:16 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb Apr 15 10:14:16 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:16 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb" returned: 0 in 0.481s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:16 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb Apr 15 10:14:16 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:16 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-51b9cb46-0ebc-4c33-a649-57219cbc3ecb" returned: 0 in 0.394s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-51b9cb46-0ebc-4c33-a649-57219cbc3ecb" released by "delete_volume" :: held 0.903s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:16 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Created reservations ['97d642f8-58e0-407e-9e41-d4d87acb6c14', 'c7489328-e4f3-45d6-b55a-24190d4bff6d', '19c0d648-e065-487c-bd12-666bd68352e5', 'e3ca8975-abb0-420b-81d9-9aa30971cf3d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:16 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:14:16 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Flow 'volume_create_manager' (71085a1a-21c6-427a-ae57-9ea1fef9ddad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec56932-b770-488f-8bf3-975280e3d61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec56932-b770-488f-8bf3-975280e3d61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-562169271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bab8063-415d-462b-8fbd-e2690567e927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9558223d38384563a47f53cda3db4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:17Z,use_quota=True,user_id='0fff312526b2421fa17ffea17505d315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11957148-b672-4ab7-8768-96823e6c6982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11957148-b672-4ab7-8768-96823e6c6982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55902011-90fa-4b2a-b8ff-229745ccf54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55902011-90fa-4b2a-b8ff-229745ccf54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bab8063-415d-462b-8fbd-e2690567e927', 'volume_name': 'volume-9bab8063-415d-462b-8fbd-e2690567e927', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ae6b08-db7a-42a1-838d-1b16cac41c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ae6b08-db7a-42a1-838d-1b16cac41c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93044b7-16a0-4c66-b9a2-2d813dec4db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:17 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Volume 9bab8063-415d-462b-8fbd-e2690567e927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bab8063-415d-462b-8fbd-e2690567e927', 'volume_size': 1} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-562169271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bab8063-415d-462b-8fbd-e2690567e927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9558223d38384563a47f53cda3db4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:17Z,use_quota=True,user_id='0fff312526b2421fa17ffea17505d315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Creating volume 9bab8063-415d-462b-8fbd-e2690567e927 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:17 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:17 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 1073741824 Apr 15 10:14:17 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:17 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.487s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Deleted volume successfully. Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-da11670a-f32e-4684-8a57-b29250072ba5 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-51b9cb46-0ebc-4c33-a649-57219cbc3ecb-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:17 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 1073741824" returned: 0 in 0.510s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:17 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 Apr 15 10:14:17 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:18 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927" returned: 0 in 0.401s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93044b7-16a0-4c66-b9a2-2d813dec4db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bab8063-415d-462b-8fbd-e2690567e927', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50b817d-7a6c-4267-a2e6-68a3e7512036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:18 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Volume volume-9bab8063-415d-462b-8fbd-e2690567e927 (9bab8063-415d-462b-8fbd-e2690567e927): created successfully Apr 15 10:14:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50b817d-7a6c-4267-a2e6-68a3e7512036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Flow 'volume_create_manager' (71085a1a-21c6-427a-ae57-9ea1fef9ddad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f6566e85-d9cd-4fd1-b3ae-0027476e682f tempest-VolumesSnapshotTestJSON-2122450131 None] Created volume successfully. Apr 15 10:14:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] Creating offline snapshot fdce5d0f-1e20-4c2f-a97b-c855757b27e0 of volume 9bab8063-415d-462b-8fbd-e2690567e927 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:14:19 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[866c0130-1b7c-456c-be12-4f2cf7e1bce1]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:19 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 Apr 15 10:14:19 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:20 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927" returned: 0 in 0.454s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:20 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 1G Apr 15 10:14:20 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:20 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 1G" returned: 0 in 0.456s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bab8063-415d-462b-8fbd-e2690567e927 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:20 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bab8063-415d-462b-8fbd-e2690567e927 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 Apr 15 10:14:20 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:20 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bab8063-415d-462b-8fbd-e2690567e927 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0" returned: 0 in 0.420s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:20 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 is being set with open permissions: ugo+rw Apr 15 10:14:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:20 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 Apr 15 10:14:20 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:21 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0" returned: 0 in 0.397s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:21 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.info Apr 15 10:14:21 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:21 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.info" returned: 0 in 0.442s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:21 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.info is being set with open permissions: ugo+rw Apr 15 10:14:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:21 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.info Apr 15 10:14:21 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:22 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.info" returned: 0 in 0.428s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f9e04518-f767-4206-b9ec-e822f8393327 tempest-VolumesSnapshotTestJSON-2122450131 None] Create snapshot completed successfully Apr 15 10:14:22 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Flow 'volume_create_manager' (4bf79b01-2d3a-4a0c-9c35-339b9168dced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3d6520-63fd-48be-918e-e9439e032240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3d6520-63fd-48be-918e-e9439e032240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-498307999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35af3d84-3d11-45a2-98a6-ae31eb13ee25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9558223d38384563a47f53cda3db4e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fdce5d0f-1e20-4c2f-a97b-c855757b27e0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:23Z,use_quota=True,user_id='0fff312526b2421fa17ffea17505d315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac968570-bdad-4e6f-9120-b20534122454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac968570-bdad-4e6f-9120-b20534122454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b8f4c1-a8b5-4f36-b9d6-86962952b7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b8f4c1-a8b5-4f36-b9d6-86962952b7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35af3d84-3d11-45a2-98a6-ae31eb13ee25', 'volume_name': 'volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25', 'volume_size': 1, 'snapshot_id': 'fdce5d0f-1e20-4c2f-a97b-c855757b27e0'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6060c2-a828-4e2e-b71d-833a6f1b3d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6060c2-a828-4e2e-b71d-833a6f1b3d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025b8983-7157-4fde-ab9e-8c8b0ab48e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:22 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Volume 35af3d84-3d11-45a2-98a6-ae31eb13ee25: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25', 'volume_size': 1, 'snapshot_id': 'fdce5d0f-1e20-4c2f-a97b-c855757b27e0'} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-fdce5d0f-1e20-4c2f-a97b-c855757b27e0-35af3d84-3d11-45a2-98a6-ae31eb13ee25" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-fdce5d0f-1e20-4c2f-a97b-c855757b27e0-35af3d84-3d11-45a2-98a6-ae31eb13ee25" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Creating volume 35af3d84-3d11-45a2-98a6-ae31eb13ee25 from snapshot fdce5d0f-1e20-4c2f-a97b-c855757b27e0 {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-35af3d84-3d11-45a2-98a6-ae31eb13ee25" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-35af3d84-3d11-45a2-98a6-ae31eb13ee25" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] snapshot: fdce5d0f-1e20-4c2f-a97b-c855757b27e0, volume: 35af3d84-3d11-45a2-98a6-ae31eb13ee25, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c00a57-5fdb-48a4-b6dc-b85469bae8c2]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:23 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 Apr 15 10:14:23 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:23 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0" returned: 0 in 0.477s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bab8063-415d-462b-8fbd-e2690567e927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] will copy from snapshot at /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb9ab5c-8b0e-4e9d-9c2b-11ec7093c274]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:23 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 Apr 15 10:14:23 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:24 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927" returned: 0 in 0.476s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:24 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Path /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:14:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:24 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25 Apr 15 10:14:24 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:25 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25" returned: 0 in 1.825s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:25 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[281944ac-f91f-41e6-9388-87c42aeaa5cf]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:25 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 Apr 15 10:14:25 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:26 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927" returned: 0 in 0.581s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:26 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927, size 1024.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:14:26 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Converted 1024.00 MB image at 560.60 MB/s Apr 15 10:14:26 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25 is being set with open permissions: ugo+rw Apr 15 10:14:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:26 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25 Apr 15 10:14:26 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:26 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25" returned: 0 in 0.384s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-35af3d84-3d11-45a2-98a6-ae31eb13ee25" released by "_copy_volume_from_snapshot" :: held 3.795s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-fdce5d0f-1e20-4c2f-a97b-c855757b27e0-35af3d84-3d11-45a2-98a6-ae31eb13ee25" released by "_create_volume_from_snapshot" :: held 3.811s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.820s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025b8983-7157-4fde-ab9e-8c8b0ab48e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25', 'volume_size': 1, 'snapshot_id': 'fdce5d0f-1e20-4c2f-a97b-c855757b27e0'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b774f34-9dc1-4732-870e-2e85ad5f1729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:26 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Volume volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25 (35af3d84-3d11-45a2-98a6-ae31eb13ee25): created successfully Apr 15 10:14:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b774f34-9dc1-4732-870e-2e85ad5f1729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Flow 'volume_create_manager' (4bf79b01-2d3a-4a0c-9c35-339b9168dced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8c6c231a-87d0-46d2-826c-1872cdf60455 tempest-VolumesSnapshotTestJSON-2122450131 None] Created volume successfully. Apr 15 10:14:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-35af3d84-3d11-45a2-98a6-ae31eb13ee25-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-35af3d84-3d11-45a2-98a6-ae31eb13ee25-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-35af3d84-3d11-45a2-98a6-ae31eb13ee25" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-35af3d84-3d11-45a2-98a6-ae31eb13ee25" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:27 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6220b7-17a7-4ee1-933c-5b21d35a2391]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:27 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25 Apr 15 10:14:27 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:27 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25" returned: 0 in 0.502s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:27 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25 Apr 15 10:14:27 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:28 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-35af3d84-3d11-45a2-98a6-ae31eb13ee25" returned: 0 in 0.412s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-35af3d84-3d11-45a2-98a6-ae31eb13ee25" released by "delete_volume" :: held 0.941s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Created reservations ['cd3589d4-9e08-467d-8b93-9c27ab2a07ef', '05e6eb5e-3f20-4531-acdf-8bdc8f8bd595', 'b119d96c-a5d0-4713-9a18-f0d22ecc6c93', 'b6a74fc4-ee35-486b-aa55-559a5fa8466b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:28 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:14:28 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-fdce5d0f-1e20-4c2f-a97b-c855757b27e0-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-fdce5d0f-1e20-4c2f-a97b-c855757b27e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-9bab8063-415d-462b-8fbd-e2690567e927" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-9bab8063-415d-462b-8fbd-e2690567e927" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-fdce5d0f-1e20-4c2f-a97b-c855757b27e0" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-fdce5d0f-1e20-4c2f-a97b-c855757b27e0" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Deleting offline snapshot fdce5d0f-1e20-4c2f-a97b-c855757b27e0 of volume 9bab8063-415d-462b-8fbd-e2690567e927 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] snapshot_file for this snap is: volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dd9910-8f57-41fa-ad1c-b7500a8f821d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:28 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 Apr 15 10:14:28 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:28 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.468s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:28 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Deleted volume successfully. Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98a7756b-6e1d-487b-86f4-484d5aed7a09 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-35af3d84-3d11-45a2-98a6-ae31eb13ee25-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:28 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0" returned: 0 in 0.495s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bab8063-415d-462b-8fbd-e2690567e927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d46b55-76fb-4168-801a-5c3dbf457946]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:28 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 Apr 15 10:14:28 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:29 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927" returned: 0 in 0.455s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:29 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 Apr 15 10:14:29 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:29 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0" returned: 0 in 0.480s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:29 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0 Apr 15 10:14:29 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:30 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927.fdce5d0f-1e20-4c2f-a97b-c855757b27e0" returned: 0 in 0.395s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-fdce5d0f-1e20-4c2f-a97b-c855757b27e0" released by "_delete_snapshot" :: held 1.885s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-9bab8063-415d-462b-8fbd-e2690567e927" released by "delete_snapshot" :: held 1.896s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:30 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Created reservations ['55c8fe8b-9776-4d93-9d40-19e9e6606900', 'f68cda6e-55e7-4d4e-8fb5-d5eac4916bfc', '329b18d0-e773-4fbf-9a99-7ef4c02211c2', 'd72e3f1e-b779-43cf-a00f-f039c028c3ba'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Delete snapshot completed successfully. Apr 15 10:14:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-321d019a-d290-412f-b0cd-d98ceb5f9ae8 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-fdce5d0f-1e20-4c2f-a97b-c855757b27e0-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-9bab8063-415d-462b-8fbd-e2690567e927-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-9bab8063-415d-462b-8fbd-e2690567e927-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-9bab8063-415d-462b-8fbd-e2690567e927" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-9bab8063-415d-462b-8fbd-e2690567e927" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:30 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e195b66-858c-4235-a332-caa3555b6c7f]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:30 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 Apr 15 10:14:30 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:31 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:31 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927 Apr 15 10:14:31 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:31 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-9bab8063-415d-462b-8fbd-e2690567e927" returned: 0 in 0.433s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-9bab8063-415d-462b-8fbd-e2690567e927" released by "delete_volume" :: held 1.001s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:31 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Created reservations ['913bf9e7-a045-497c-aaf7-bf8a13094182', '49821569-ae60-4dd0-ab2d-106133a2ed55', '7d8cd2c5-5531-4ea0-95bf-c7f2d544a27e', '30583dcf-253d-4b79-8779-2a96eeed8bb5'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:31 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:14:31 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:32 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.412s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:32 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Deleted volume successfully. Apr 15 10:14:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-43c71e8c-f9ab-409e-aedd-53eedbb8d0a6 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-9bab8063-415d-462b-8fbd-e2690567e927-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-081b2f9f-e298-4721-ac88-4d86d943c6bd-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-081b2f9f-e298-4721-ac88-4d86d943c6bd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "cinder-quobyte-081b2f9f-e298-4721-ac88-4d86d943c6bd" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-081b2f9f-e298-4721-ac88-4d86d943c6bd" acquired by "delete_volume" :: waited 0.006s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:32 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a368acf-9c95-45a2-a2aa-ed7cca91ab60]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:32 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd Apr 15 10:14:32 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:33 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd" returned: 0 in 0.496s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:33 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd Apr 15 10:14:33 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:33 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-081b2f9f-e298-4721-ac88-4d86d943c6bd" returned: 0 in 0.421s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-quobyte-081b2f9f-e298-4721-ac88-4d86d943c6bd" released by "delete_volume" :: held 0.953s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:33 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Created reservations ['16688002-7711-4b33-afaf-64d4bc0ec0ad', 'b7309778-1735-48bf-8196-e3c23684401d', 'c189391c-a397-4d5c-ab03-19237da7b697', '28bde813-4450-497a-b7b5-1a2fc0aff361'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:33 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:14:33 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:34 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.445s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:34 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Deleted volume successfully. Apr 15 10:14:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3a221b97-32e8-4a4f-9aaf-f5c5f1eedb78 tempest-VolumesSnapshotTestJSON-2122450131 None] Lock "cinder-081b2f9f-e298-4721-ac88-4d86d943c6bd-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:37 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:14:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:37 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:14:37 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:38 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.448s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:38 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:43 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=88,cinder:SELECT=79,cinder:INSERT=16,cinder:DELETE=5 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:14:44 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=69,cinder:INSERT=26,cinder:UPDATE=77,cinder:DELETE=9 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Flow 'volume_create_manager' (fd15ea80-b874-4027-a07c-9361dc680a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8167568-8dd5-4653-a7c5-ad1382069fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8167568-8dd5-4653-a7c5-ad1382069fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1940557616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e45e84d2-939b-4575-b9b3-5e2f22d1977b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb303464e0ed4f4c874ac10ee612fa27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:51Z,use_quota=True,user_id='d10b953a1f19459ebbe66e7f8e3da357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0793e211-7521-48fb-bbcb-ef7ab74959cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0793e211-7521-48fb-bbcb-ef7ab74959cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18841716-2868-4015-8139-1025f0518e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18841716-2868-4015-8139-1025f0518e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e45e84d2-939b-4575-b9b3-5e2f22d1977b', 'volume_name': 'volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa48cca1-74fb-4823-b94a-1ed1dc1cc016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa48cca1-74fb-4823-b94a-1ed1dc1cc016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51a6daf-e044-4956-9a1b-6243d378be6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:51 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Volume e45e84d2-939b-4575-b9b3-5e2f22d1977b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b', 'volume_size': 1} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1940557616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e45e84d2-939b-4575-b9b3-5e2f22d1977b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb303464e0ed4f4c874ac10ee612fa27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:51Z,use_quota=True,user_id='d10b953a1f19459ebbe66e7f8e3da357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Creating volume e45e84d2-939b-4575-b9b3-5e2f22d1977b {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:51 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:51 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b 1073741824 Apr 15 10:14:51 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:51 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b 1073741824" returned: 0 in 0.565s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:51 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b Apr 15 10:14:51 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:52 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b" returned: 0 in 0.419s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51a6daf-e044-4956-9a1b-6243d378be6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5425527-a376-4298-a4f4-55a7bf89d719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:52 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Volume volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b (e45e84d2-939b-4575-b9b3-5e2f22d1977b): created successfully Apr 15 10:14:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5425527-a376-4298-a4f4-55a7bf89d719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Flow 'volume_create_manager' (fd15ea80-b874-4027-a07c-9361dc680a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:52 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ee45d94f-61ac-4bda-a6d9-69bba24fc151 tempest-SnapshotDependencyTests-156118716 None] Created volume successfully. Apr 15 10:14:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] Creating offline snapshot a8a6db0f-3205-43f1-b148-166ba7b3b504 of volume e45e84d2-939b-4575-b9b3-5e2f22d1977b {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:14:53 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2544c65-b717-4edc-9636-3b4afd4b7e49]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:53 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b Apr 15 10:14:53 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:53 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b" returned: 0 in 0.495s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:53 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 1G Apr 15 10:14:53 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:54 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 1G" returned: 0 in 0.501s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:54 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 Apr 15 10:14:54 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:54 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504" returned: 0 in 0.438s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:54 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 is being set with open permissions: ugo+rw Apr 15 10:14:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:54 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 Apr 15 10:14:54 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:55 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504" returned: 0 in 0.409s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:55 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.info Apr 15 10:14:55 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:55 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.info" returned: 0 in 0.413s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:55 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.info is being set with open permissions: ugo+rw Apr 15 10:14:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:55 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.info Apr 15 10:14:55 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:56 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.info" returned: 0 in 0.427s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.747s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e68e72ab-56e6-4787-ac4a-62c316c986bc tempest-SnapshotDependencyTests-156118716 None] Create snapshot completed successfully Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Flow 'volume_create_manager' (b3802bce-3c58-4f24-a6b4-8efd685cf92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb251c8-c45c-4d0f-99c0-e4d02c9e07a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb251c8-c45c-4d0f-99c0-e4d02c9e07a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0fed0c8-fdbc-4f97-959c-574430abb969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb303464e0ed4f4c874ac10ee612fa27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a8a6db0f-3205-43f1-b148-166ba7b3b504,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:57Z,use_quota=True,user_id='d10b953a1f19459ebbe66e7f8e3da357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9353fc2c-4585-4426-8c87-0b4df315f9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9353fc2c-4585-4426-8c87-0b4df315f9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a809ec49-a46e-4642-bf98-91a470153fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a809ec49-a46e-4642-bf98-91a470153fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f0fed0c8-fdbc-4f97-959c-574430abb969', 'volume_name': 'volume-f0fed0c8-fdbc-4f97-959c-574430abb969', 'volume_size': 1, 'snapshot_id': 'a8a6db0f-3205-43f1-b148-166ba7b3b504'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c757a9f9-4b50-428d-8ec9-d75d14a93a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c757a9f9-4b50-428d-8ec9-d75d14a93a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0e6734-fae8-4106-a3eb-7738b5826c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:56 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Volume f0fed0c8-fdbc-4f97-959c-574430abb969: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f0fed0c8-fdbc-4f97-959c-574430abb969', 'volume_size': 1, 'snapshot_id': 'a8a6db0f-3205-43f1-b148-166ba7b3b504'} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "cinder-quobyte-a8a6db0f-3205-43f1-b148-166ba7b3b504-f0fed0c8-fdbc-4f97-959c-574430abb969" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-quobyte-a8a6db0f-3205-43f1-b148-166ba7b3b504-f0fed0c8-fdbc-4f97-959c-574430abb969" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Creating volume f0fed0c8-fdbc-4f97-959c-574430abb969 from snapshot a8a6db0f-3205-43f1-b148-166ba7b3b504 {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "cinder-quobyte-f0fed0c8-fdbc-4f97-959c-574430abb969" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-quobyte-f0fed0c8-fdbc-4f97-959c-574430abb969" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] snapshot: a8a6db0f-3205-43f1-b148-166ba7b3b504, volume: f0fed0c8-fdbc-4f97-959c-574430abb969, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[09df8573-25cf-4859-8f48-5e1c0dfa6ca2]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:56 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 Apr 15 10:14:56 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:57 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504" returned: 0 in 0.455s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] will copy from snapshot at /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:14:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:14:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4147dc9c-7b87-4117-b7c4-30f2a30f41fb]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:57 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b Apr 15 10:14:57 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:57 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b" returned: 0 in 0.488s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:57 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Path /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:14:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:57 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969 Apr 15 10:14:57 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:59 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969" returned: 0 in 1.857s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:59 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0057e4e-782e-4587-bfb2-60060d85d793]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:59 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b Apr 15 10:14:59 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:00 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b" returned: 0 in 0.583s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:00 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b, size 1024.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:15:00 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Converted 1024.00 MB image at 550.73 MB/s Apr 15 10:15:00 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969 is being set with open permissions: ugo+rw Apr 15 10:15:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:00 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969 Apr 15 10:15:00 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:00 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969" returned: 0 in 0.422s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-quobyte-f0fed0c8-fdbc-4f97-959c-574430abb969" released by "_copy_volume_from_snapshot" :: held 3.862s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-quobyte-a8a6db0f-3205-43f1-b148-166ba7b3b504-f0fed0c8-fdbc-4f97-959c-574430abb969" released by "_create_volume_from_snapshot" :: held 3.880s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.888s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0e6734-fae8-4106-a3eb-7738b5826c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0fed0c8-fdbc-4f97-959c-574430abb969', 'volume_size': 1, 'snapshot_id': 'a8a6db0f-3205-43f1-b148-166ba7b3b504'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f239ffdc-712a-4718-8c25-665cd1d17fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:00 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Volume volume-f0fed0c8-fdbc-4f97-959c-574430abb969 (f0fed0c8-fdbc-4f97-959c-574430abb969): created successfully Apr 15 10:15:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f239ffdc-712a-4718-8c25-665cd1d17fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Flow 'volume_create_manager' (b3802bce-3c58-4f24-a6b4-8efd685cf92b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:00 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-93beadf8-9bfd-429f-afd9-c624e07ab4dd tempest-SnapshotDependencyTests-156118716 None] Created volume successfully. Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "cinder-a8a6db0f-3205-43f1-b148-166ba7b3b504-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-a8a6db0f-3205-43f1-b148-166ba7b3b504-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "cinder-quobyte-e45e84d2-939b-4575-b9b3-5e2f22d1977b" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-quobyte-e45e84d2-939b-4575-b9b3-5e2f22d1977b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "cinder-quobyte-a8a6db0f-3205-43f1-b148-166ba7b3b504" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-quobyte-a8a6db0f-3205-43f1-b148-166ba7b3b504" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Deleting offline snapshot a8a6db0f-3205-43f1-b148-166ba7b3b504 of volume e45e84d2-939b-4575-b9b3-5e2f22d1977b {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] snapshot_file for this snap is: volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f016f8be-e969-4cbb-84bb-f050457622b2]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:01 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 Apr 15 10:15:01 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:01 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504" returned: 0 in 0.514s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[595d5740-3a8c-4b85-84c2-db0ab987c7fb]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:01 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b Apr 15 10:15:01 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:02 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b" returned: 0 in 0.493s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:02 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 Apr 15 10:15:02 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:02 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504" returned: 0 in 0.473s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:02 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504 Apr 15 10:15:02 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:03 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b.a8a6db0f-3205-43f1-b148-166ba7b3b504" returned: 0 in 0.443s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-quobyte-a8a6db0f-3205-43f1-b148-166ba7b3b504" released by "_delete_snapshot" :: held 1.982s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-quobyte-e45e84d2-939b-4575-b9b3-5e2f22d1977b" released by "delete_snapshot" :: held 1.997s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:03 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Created reservations ['78d98b0d-759a-4398-b208-0a2ac193c742', 'af49b7ca-93b7-4aa2-b86c-064a3dc9f96b', '8f924e50-a527-4c09-8059-2d1d0b4e7650', '83718c46-00a6-42a4-875b-0ed010a9ea66'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:03 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Delete snapshot completed successfully. Apr 15 10:15:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-55fa4444-524e-41fb-bbe8-d451f69df5d0 tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-a8a6db0f-3205-43f1-b148-166ba7b3b504-delete_snapshot" released by "delete_snapshot" :: held 2.094s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "cinder-e45e84d2-939b-4575-b9b3-5e2f22d1977b-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-e45e84d2-939b-4575-b9b3-5e2f22d1977b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "cinder-quobyte-e45e84d2-939b-4575-b9b3-5e2f22d1977b" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-quobyte-e45e84d2-939b-4575-b9b3-5e2f22d1977b" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[168ca67c-3827-41a3-92b5-48807f89a65a]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:04 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b Apr 15 10:15:04 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:04 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b" returned: 0 in 0.492s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:04 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b Apr 15 10:15:04 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:05 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e45e84d2-939b-4575-b9b3-5e2f22d1977b" returned: 0 in 0.394s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-quobyte-e45e84d2-939b-4575-b9b3-5e2f22d1977b" released by "delete_volume" :: held 0.917s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Created reservations ['e5b934a1-8442-4b05-afaa-844fbe546741', '8cd687f5-4f8c-4a27-a251-5943830ab2d1', 'c6b58a6f-3d24-4412-8d86-1686eb1455e7', '47186fa2-c13b-40a5-bbd3-d162c573632f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:05 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:05 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "cinder-f0fed0c8-fdbc-4f97-959c-574430abb969-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-f0fed0c8-fdbc-4f97-959c-574430abb969-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "cinder-quobyte-f0fed0c8-fdbc-4f97-959c-574430abb969" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-quobyte-f0fed0c8-fdbc-4f97-959c-574430abb969" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[921b54a5-000d-4db9-9135-4e9780c2b21f]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:05 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969 Apr 15 10:15:05 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:05 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.447s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:05 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Deleted volume successfully. Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2c00dfed-eae5-4166-97d4-7bc753e1be3f tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-e45e84d2-939b-4575-b9b3-5e2f22d1977b-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:05 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969" returned: 0 in 0.499s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:05 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969 Apr 15 10:15:05 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:06 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f0fed0c8-fdbc-4f97-959c-574430abb969" returned: 0 in 0.430s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-quobyte-f0fed0c8-fdbc-4f97-959c-574430abb969" released by "delete_volume" :: held 0.963s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:06 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Created reservations ['e159d641-f49e-411a-8f41-00fd3b06a132', '18ccea1f-3d21-47de-bba5-b3b4bfc265da', 'e01ca14f-7368-4f06-83c8-56ea6491a0a3', '1d690f34-a89d-4111-99ca-b9afc55e4460'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:06 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:06 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:06 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.444s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:06 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Deleted volume successfully. Apr 15 10:15:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-030cd62c-20b4-4cc0-b91c-a62b9aebdf35 tempest-SnapshotDependencyTests-156118716 None] Lock "cinder-f0fed0c8-fdbc-4f97-959c-574430abb969-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:16 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=27,cinder:SELECT=26,cinder:INSERT=8,cinder:DELETE=2 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:15:16 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=22,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=6 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Flow 'volume_create_manager' (8e5f6e15-fd58-4952-97ac-a5f7d39d6bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacb975e-3628-4be6-a641-4b238b9f09d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacb975e-3628-4be6-a641-4b238b9f09d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1018830667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fe76fbf5494f649cc799ca6efe901e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:20Z,use_quota=True,user_id='f5690a58994a4451b17b9afe3ab5b98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f647fde-4bcd-4da3-8eed-24648bf8fd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f647fde-4bcd-4da3-8eed-24648bf8fd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55980529-d28c-4f6f-900a-ecd94f683f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55980529-d28c-4f6f-900a-ecd94f683f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6', 'volume_name': 'volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7455971a-36d9-4baf-b799-1482f8d4f564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7455971a-36d9-4baf-b799-1482f8d4f564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d2dbeb-fde0-4fef-a4e9-5783619202bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:19 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6', 'volume_size': 1} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1018830667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fe76fbf5494f649cc799ca6efe901e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:20Z,use_quota=True,user_id='f5690a58994a4451b17b9afe3ab5b98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Creating volume f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:19 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:19 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 1073741824 Apr 15 10:15:19 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Flow 'volume_create_manager' (2f037257-b98e-4761-a82c-e61c5fc7d06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f543125-ed87-4dee-93b0-5e7191141212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f543125-ed87-4dee-93b0-5e7191141212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337167046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5af5a03-ff09-442b-bd39-9cf647fdf334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0a8237dec34b6d988a1cd1d3cf22b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:20Z,use_quota=True,user_id='d92c602b5d6a4c8781452967a103c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04465e62-535b-48ac-afc0-421952cc14a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04465e62-535b-48ac-afc0-421952cc14a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d37fb9-d28c-4bcb-a8b2-8c1fd9907d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d37fb9-d28c-4bcb-a8b2-8c1fd9907d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5af5a03-ff09-442b-bd39-9cf647fdf334', 'volume_name': 'volume-b5af5a03-ff09-442b-bd39-9cf647fdf334', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd1b384-f991-448f-993b-af64dc0e4f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd1b384-f991-448f-993b-af64dc0e4f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ade97d-edde-401a-8d73-049c7f159bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:19 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume b5af5a03-ff09-442b-bd39-9cf647fdf334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5af5a03-ff09-442b-bd39-9cf647fdf334', 'volume_size': 1} Apr 15 10:15:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Flow 'volume_create_manager' (9fe5d22c-f58a-43f0-82d6-e05808db9f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3bf170-504c-4c66-bc12-876b70f43be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3bf170-504c-4c66-bc12-876b70f43be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1799724860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec92f6f-1358-4a9c-9730-e58dca9753a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fabf3ab0d5249cbb74dab6ec55a415e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:20Z,use_quota=True,user_id='ef862c4162a3417d930ae1ac735866bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701efeb4-dc94-4ab6-97f5-74e918c553f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701efeb4-dc94-4ab6-97f5-74e918c553f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e6de55-14b9-417a-b5a3-cfdb44369f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e6de55-14b9-417a-b5a3-cfdb44369f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec92f6f-1358-4a9c-9730-e58dca9753a1', 'volume_name': 'volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5054a925-0c14-45a3-b09d-46fc984aafd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5054a925-0c14-45a3-b09d-46fc984aafd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ce9312-aa82-4acb-b054-493b9825f72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Volume 7ec92f6f-1358-4a9c-9730-e58dca9753a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1', 'volume_size': 1} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Flow 'volume_create_manager' (e79639ee-514b-4850-a9fb-e5f0e2c1834f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1003b581-59a0-4d3d-a7c9-76413f86023f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1003b581-59a0-4d3d-a7c9-76413f86023f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1117277301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d744f513-6b81-4e24-a821-aed5d87248bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ca60de4f1a84d94baf109cd7e3798c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:20Z,use_quota=True,user_id='55b46c4a7ba14a9c97023b6d654a81ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4db8157-a922-44b1-beb2-931ea25cc9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4db8157-a922-44b1-beb2-931ea25cc9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20555548-665a-4ea2-85a0-9720a09173bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20555548-665a-4ea2-85a0-9720a09173bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd744f513-6b81-4e24-a821-aed5d87248bc', 'volume_name': 'volume-d744f513-6b81-4e24-a821-aed5d87248bc', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52caae6-eac6-4fbf-abd4-0b68ec52ac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52caae6-eac6-4fbf-abd4-0b68ec52ac52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e821a0d-1d6e-4b26-9a30-9227a4cd91cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Volume d744f513-6b81-4e24-a821-aed5d87248bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d744f513-6b81-4e24-a821-aed5d87248bc', 'volume_size': 1} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Flow 'volume_create_manager' (887949ae-9bf3-4562-8b19-1df3ea461dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a98ddee-a9ee-4da5-9959-003dcf990e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a98ddee-a9ee-4da5-9959-003dcf990e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-299377964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3874df62-69d8-4589-a46e-2bfbc66f2ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fabf3ab0d5249cbb74dab6ec55a415e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:20Z,use_quota=True,user_id='ef862c4162a3417d930ae1ac735866bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb26b396-746a-4fb2-aa3a-27b788b7d86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb26b396-746a-4fb2-aa3a-27b788b7d86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7296f397-cda2-4b25-bbf2-0e0900035957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7296f397-cda2-4b25-bbf2-0e0900035957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3874df62-69d8-4589-a46e-2bfbc66f2ae9', 'volume_name': 'volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc307a8-7ba5-44fe-a7c3-c07a9e4bc3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc307a8-7ba5-44fe-a7c3-c07a9e4bc3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9df90d-b1d9-4d1c-bea7-3756f8574339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Volume 3874df62-69d8-4589-a46e-2bfbc66f2ae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9', 'volume_size': 1} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 1073741824" returned: 0 in 0.651s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:20 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 Apr 15 10:15:20 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Flow 'volume_create_manager' (a2790723-439b-4921-a4b3-475609d56173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6040dfa8-71a7-4c98-9bf8-7df43d5a4510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6040dfa8-71a7-4c98-9bf8-7df43d5a4510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1543786517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff4cf10-7011-47c8-98d1-12ba0257149f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fabf3ab0d5249cbb74dab6ec55a415e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:20Z,use_quota=True,user_id='ef862c4162a3417d930ae1ac735866bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fabc2bb-cdb7-429e-a387-94409356ada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fabc2bb-cdb7-429e-a387-94409356ada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3f6071-e763-450f-8c6f-7038551f232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3f6071-e763-450f-8c6f-7038551f232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff4cf10-7011-47c8-98d1-12ba0257149f', 'volume_name': 'volume-eff4cf10-7011-47c8-98d1-12ba0257149f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb1cb5b-d8e2-4eb8-892a-6056d88d2cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb1cb5b-d8e2-4eb8-892a-6056d88d2cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6897ff-5caa-4f95-a368-f57b70e5500c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Volume eff4cf10-7011-47c8-98d1-12ba0257149f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff4cf10-7011-47c8-98d1-12ba0257149f', 'volume_size': 1} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Flow 'volume_create_manager' (cb475b41-86f0-4292-8918-ab138620bea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f44871-8578-4978-9b1a-b9cca44853da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f44871-8578-4978-9b1a-b9cca44853da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-46548273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf1e57e-6b20-4c17-a75d-8305acb351ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fabf3ab0d5249cbb74dab6ec55a415e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:21Z,use_quota=True,user_id='ef862c4162a3417d930ae1ac735866bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52f9be9-67df-4aa3-9b0b-504fc9d27b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52f9be9-67df-4aa3-9b0b-504fc9d27b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e3f796-a2c3-4faf-b91e-fbf4b180bbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e3f796-a2c3-4faf-b91e-fbf4b180bbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf1e57e-6b20-4c17-a75d-8305acb351ab', 'volume_name': 'volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256324b2-01c5-4e43-ae6b-5692f566301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256324b2-01c5-4e43-ae6b-5692f566301a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759e4b1e-8fbc-45d1-97fb-29e3df1565b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Volume 8bf1e57e-6b20-4c17-a75d-8305acb351ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab', 'volume_size': 1} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:20 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6" returned: 0 in 0.432s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.941s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337167046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5af5a03-ff09-442b-bd39-9cf647fdf334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0a8237dec34b6d988a1cd1d3cf22b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:20Z,use_quota=True,user_id='d92c602b5d6a4c8781452967a103c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Creating volume b5af5a03-ff09-442b-bd39-9cf647fdf334 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:20 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5af5a03-ff09-442b-bd39-9cf647fdf334 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:20 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5af5a03-ff09-442b-bd39-9cf647fdf334 1073741824 Apr 15 10:15:20 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d2dbeb-fde0-4fef-a4e9-5783619202bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da4347c-926f-4e5c-9221-ddf9be0ca309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:20 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 (f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6): created successfully Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da4347c-926f-4e5c-9221-ddf9be0ca309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Flow 'volume_create_manager' (8e5f6e15-fd58-4952-97ac-a5f7d39d6bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f3c4a92f-31cb-4679-bebe-083c9461c88b tempest-CreateVolumesFromSnapshotTest-1591415377 None] Created volume successfully. Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Flow 'volume_create_manager' (d3240c3c-e183-41c1-9109-c094952bee2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c79aa9-4751-41d9-8b47-e0b9df161500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c79aa9-4751-41d9-8b47-e0b9df161500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-30547294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c56ddb-28c1-4f97-914c-0a75575de296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fabf3ab0d5249cbb74dab6ec55a415e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:21Z,use_quota=True,user_id='ef862c4162a3417d930ae1ac735866bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d82a1d-cbd5-4f84-8679-aa3260abe3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d82a1d-cbd5-4f84-8679-aa3260abe3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5bd681-7890-426a-a24e-761bd6e3d7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5bd681-7890-426a-a24e-761bd6e3d7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c56ddb-28c1-4f97-914c-0a75575de296', 'volume_name': 'volume-09c56ddb-28c1-4f97-914c-0a75575de296', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5486e3d7-fb23-4530-ac8a-3d4b051b8a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5486e3d7-fb23-4530-ac8a-3d4b051b8a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa65afae-3df1-4a43-a4fd-5ee5215c4c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:21 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Volume 09c56ddb-28c1-4f97-914c-0a75575de296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c56ddb-28c1-4f97-914c-0a75575de296', 'volume_size': 1} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:21 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5af5a03-ff09-442b-bd39-9cf647fdf334 1073741824" returned: 0 in 0.633s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5af5a03-ff09-442b-bd39-9cf647fdf334 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:21 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5af5a03-ff09-442b-bd39-9cf647fdf334 Apr 15 10:15:21 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:21 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5af5a03-ff09-442b-bd39-9cf647fdf334" returned: 0 in 0.386s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.759s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1799724860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec92f6f-1358-4a9c-9730-e58dca9753a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fabf3ab0d5249cbb74dab6ec55a415e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:20Z,use_quota=True,user_id='ef862c4162a3417d930ae1ac735866bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Creating volume 7ec92f6f-1358-4a9c-9730-e58dca9753a1 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:21 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ade97d-edde-401a-8d73-049c7f159bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5af5a03-ff09-442b-bd39-9cf647fdf334', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c91b66d-054d-4516-b728-833dfac2e2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:21 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1 1073741824 Apr 15 10:15:21 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:21 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume volume-b5af5a03-ff09-442b-bd39-9cf647fdf334 (b5af5a03-ff09-442b-bd39-9cf647fdf334): created successfully Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c91b66d-054d-4516-b728-833dfac2e2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Flow 'volume_create_manager' (2f037257-b98e-4761-a82c-e61c5fc7d06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:21 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b50c385a-b932-4725-b4dd-1955f5a9edfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Created volume successfully. Apr 15 10:15:22 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1 1073741824" returned: 0 in 0.513s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:22 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1 Apr 15 10:15:22 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Flow 'volume_create_manager' (7c41b94f-f437-41b0-b1f1-1f400a5b6c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915c9ee1-51f7-4a93-b96b-2f54a00e9bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915c9ee1-51f7-4a93-b96b-2f54a00e9bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-112678228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09950081-db3f-4b13-939b-223990efae28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0a8237dec34b6d988a1cd1d3cf22b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:23Z,use_quota=True,user_id='d92c602b5d6a4c8781452967a103c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d8ede4-2e4e-487a-8af6-e6c651e20c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d8ede4-2e4e-487a-8af6-e6c651e20c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c473c2d-f454-4683-bd21-fe3fb0983cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c473c2d-f454-4683-bd21-fe3fb0983cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09950081-db3f-4b13-939b-223990efae28', 'volume_name': 'volume-09950081-db3f-4b13-939b-223990efae28', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab78a49-9b5a-4712-a4d2-4561db48495f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab78a49-9b5a-4712-a4d2-4561db48495f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae31d46b-06aa-40d5-a99f-e445211d76db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:22 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume 09950081-db3f-4b13-939b-223990efae28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09950081-db3f-4b13-939b-223990efae28', 'volume_size': 1} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Flow 'volume_create_manager' (09bd2ed8-fa1f-43af-a89c-86f417b181ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234c9db9-9b6a-4e49-887d-923de3c44680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234c9db9-9b6a-4e49-887d-923de3c44680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-899378799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec93ebc-5db4-4c62-b73b-faf5ee281d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0a8237dec34b6d988a1cd1d3cf22b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:23Z,use_quota=True,user_id='d92c602b5d6a4c8781452967a103c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2643c02c-2704-49dc-960b-a82dc099cfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2643c02c-2704-49dc-960b-a82dc099cfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5849fa92-2e04-426f-99dd-3edec509c83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5849fa92-2e04-426f-99dd-3edec509c83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec93ebc-5db4-4c62-b73b-faf5ee281d33', 'volume_name': 'volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99739e3d-33f5-4c5b-976e-fd0975c138ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99739e3d-33f5-4c5b-976e-fd0975c138ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fdc907-0130-4a02-a18b-952c00a6e3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:22 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume 0ec93ebc-5db4-4c62-b73b-faf5ee281d33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33', 'volume_size': 1} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:22 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Flow 'volume_create_manager' (dff4d14d-37f6-4fd1-93cd-ed2582e5d571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9af3ca-d2f1-4426-b2cf-4cfc5bddc3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1" returned: 0 in 0.551s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.735s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1117277301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d744f513-6b81-4e24-a821-aed5d87248bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ca60de4f1a84d94baf109cd7e3798c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:20Z,use_quota=True,user_id='55b46c4a7ba14a9c97023b6d654a81ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Creating volume d744f513-6b81-4e24-a821-aed5d87248bc {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:22 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9af3ca-d2f1-4426-b2cf-4cfc5bddc3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1126019545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c6aac5-b789-4fe8-abfb-ec1d18b7d585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0a8237dec34b6d988a1cd1d3cf22b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:23Z,use_quota=True,user_id='d92c602b5d6a4c8781452967a103c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc 1073741824 Apr 15 10:15:23 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0019f523-f75f-4b0c-beea-e096f7bd8c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0019f523-f75f-4b0c-beea-e096f7bd8c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72566c1c-321c-403f-ab59-638fcab18b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72566c1c-321c-403f-ab59-638fcab18b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c6aac5-b789-4fe8-abfb-ec1d18b7d585', 'volume_name': 'volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e4de15-136c-4211-bf1d-b06f010c8605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e4de15-136c-4211-bf1d-b06f010c8605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cbcb72-88b5-4f30-b7da-e5720824dd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume 95c6aac5-b789-4fe8-abfb-ec1d18b7d585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585', 'volume_size': 1} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ce9312-aa82-4acb-b054-493b9825f72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d58fdd9-73f7-4993-ad48-d7ec3a20a05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Volume volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1 (7ec92f6f-1358-4a9c-9730-e58dca9753a1): created successfully Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d58fdd9-73f7-4993-ad48-d7ec3a20a05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Flow 'volume_create_manager' (9fe5d22c-f58a-43f0-82d6-e05808db9f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7c75262b-6dbf-428f-9c60-f113a139c362 tempest-CreateVolumesFromImageTest-1240634869 None] Created volume successfully. Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Flow 'volume_create_manager' (f6d64bb7-2056-4ec9-bbb8-73fb105c9389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625c784b-cd6a-417a-aa03-63f5930c6c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625c784b-cd6a-417a-aa03-63f5930c6c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135391028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39bebd1-9519-4d41-a029-8b98720bb9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0a8237dec34b6d988a1cd1d3cf22b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:23Z,use_quota=True,user_id='d92c602b5d6a4c8781452967a103c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f084d8ce-4cea-4aba-9550-adea5055f42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f084d8ce-4cea-4aba-9550-adea5055f42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0c6127-be23-4f07-8794-414495478c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0c6127-be23-4f07-8794-414495478c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c39bebd1-9519-4d41-a029-8b98720bb9f6', 'volume_name': 'volume-c39bebd1-9519-4d41-a029-8b98720bb9f6', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f70713a-9213-458c-a040-c1f439df6c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f70713a-9213-458c-a040-c1f439df6c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af79d50-4e02-4231-abf1-e699cbafc77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume c39bebd1-9519-4d41-a029-8b98720bb9f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c39bebd1-9519-4d41-a029-8b98720bb9f6', 'volume_size': 1} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Flow 'volume_create_manager' (331a60d0-b7d0-4c63-96ff-1c91502fdd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac59f39-e063-4ae6-81f9-20826dcf6119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac59f39-e063-4ae6-81f9-20826dcf6119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2030971208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a07ee48-12e3-4df8-b0aa-b6e729ec232c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0a8237dec34b6d988a1cd1d3cf22b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:23Z,use_quota=True,user_id='d92c602b5d6a4c8781452967a103c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5d1cad-3faa-4bfa-8eb4-f1f350845f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5d1cad-3faa-4bfa-8eb4-f1f350845f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0513ced-1073-4f98-8ec4-2b10094fbaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0513ced-1073-4f98-8ec4-2b10094fbaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a07ee48-12e3-4df8-b0aa-b6e729ec232c', 'volume_name': 'volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fc27c9-4090-4f97-94fb-363250a8e4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fc27c9-4090-4f97-94fb-363250a8e4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc100c23-5f1a-4efa-9d0e-43768059db25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume 5a07ee48-12e3-4df8-b0aa-b6e729ec232c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c', 'volume_size': 1} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:23 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc 1073741824" returned: 0 in 0.566s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:23 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc Apr 15 10:15:23 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:23 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc" returned: 0 in 0.413s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.664s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-299377964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3874df62-69d8-4589-a46e-2bfbc66f2ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fabf3ab0d5249cbb74dab6ec55a415e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:20Z,use_quota=True,user_id='ef862c4162a3417d930ae1ac735866bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Creating volume 3874df62-69d8-4589-a46e-2bfbc66f2ae9 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:24 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e821a0d-1d6e-4b26-9a30-9227a4cd91cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d744f513-6b81-4e24-a821-aed5d87248bc', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:24 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9 1073741824 Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bfa7f9-0b49-4de3-873f-7b3e943d98dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:24 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:24 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Volume volume-d744f513-6b81-4e24-a821-aed5d87248bc (d744f513-6b81-4e24-a821-aed5d87248bc): created successfully Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bfa7f9-0b49-4de3-873f-7b3e943d98dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Flow 'volume_create_manager' (e79639ee-514b-4850-a9fb-e5f0e2c1834f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2fc3cf44-b7fa-4ea2-a20e-4545b32bb27a tempest-VolumeDependencyTests-1062553553 None] Created volume successfully. Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:24 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9 1073741824" returned: 0 in 0.515s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:24 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9 Apr 15 10:15:24 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:24 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9" returned: 0 in 0.401s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.449s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1543786517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff4cf10-7011-47c8-98d1-12ba0257149f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fabf3ab0d5249cbb74dab6ec55a415e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:20Z,use_quota=True,user_id='ef862c4162a3417d930ae1ac735866bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Creating volume eff4cf10-7011-47c8-98d1-12ba0257149f {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:24 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-eff4cf10-7011-47c8-98d1-12ba0257149f 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9df90d-b1d9-4d1c-bea7-3756f8574339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:24 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-eff4cf10-7011-47c8-98d1-12ba0257149f 1073741824 Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0925ae9-859c-4cc6-9fc1-996c35cf52e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:24 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:24 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Volume volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9 (3874df62-69d8-4589-a46e-2bfbc66f2ae9): created successfully Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0925ae9-859c-4cc6-9fc1-996c35cf52e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Flow 'volume_create_manager' (887949ae-9bf3-4562-8b19-1df3ea461dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-48634ed1-88c3-43f7-b4c1-5ea51452905c tempest-CreateVolumesFromImageTest-1240634869 None] Created volume successfully. Apr 15 10:15:25 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-eff4cf10-7011-47c8-98d1-12ba0257149f 1073741824" returned: 0 in 0.480s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-eff4cf10-7011-47c8-98d1-12ba0257149f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:25 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-eff4cf10-7011-47c8-98d1-12ba0257149f Apr 15 10:15:25 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:25 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-eff4cf10-7011-47c8-98d1-12ba0257149f" returned: 0 in 0.402s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.173s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-46548273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf1e57e-6b20-4c17-a75d-8305acb351ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fabf3ab0d5249cbb74dab6ec55a415e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:21Z,use_quota=True,user_id='ef862c4162a3417d930ae1ac735866bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Creating volume 8bf1e57e-6b20-4c17-a75d-8305acb351ab {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:25 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6897ff-5caa-4f95-a368-f57b70e5500c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff4cf10-7011-47c8-98d1-12ba0257149f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab 1073741824 Apr 15 10:15:25 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656c7024-c573-4266-b2ef-10fe66bcdc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Volume volume-eff4cf10-7011-47c8-98d1-12ba0257149f (eff4cf10-7011-47c8-98d1-12ba0257149f): created successfully Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656c7024-c573-4266-b2ef-10fe66bcdc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Flow 'volume_create_manager' (a2790723-439b-4921-a4b3-475609d56173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f273e4db-49f0-41ca-8b3c-1919763060f4 tempest-CreateVolumesFromImageTest-1240634869 None] Created volume successfully. Apr 15 10:15:26 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab 1073741824" returned: 0 in 0.499s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:26 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab Apr 15 10:15:26 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:26 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab" returned: 0 in 0.407s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.697s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-30547294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c56ddb-28c1-4f97-914c-0a75575de296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fabf3ab0d5249cbb74dab6ec55a415e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:21Z,use_quota=True,user_id='ef862c4162a3417d930ae1ac735866bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Creating volume 09c56ddb-28c1-4f97-914c-0a75575de296 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:26 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09c56ddb-28c1-4f97-914c-0a75575de296 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759e4b1e-8fbc-45d1-97fb-29e3df1565b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09c56ddb-28c1-4f97-914c-0a75575de296 1073741824 Apr 15 10:15:26 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24055c4-4415-474c-9274-52dbd9304540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Volume volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab (8bf1e57e-6b20-4c17-a75d-8305acb351ab): created successfully Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24055c4-4415-474c-9274-52dbd9304540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Flow 'volume_create_manager' (cb475b41-86f0-4292-8918-ab138620bea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a3fedeee-b595-497e-93d8-6831eaa2e490 tempest-CreateVolumesFromImageTest-1240634869 None] Created volume successfully. Apr 15 10:15:27 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09c56ddb-28c1-4f97-914c-0a75575de296 1073741824" returned: 0 in 0.456s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09c56ddb-28c1-4f97-914c-0a75575de296 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:27 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09c56ddb-28c1-4f97-914c-0a75575de296 Apr 15 10:15:27 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:27 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09c56ddb-28c1-4f97-914c-0a75575de296" returned: 0 in 0.424s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.522s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa65afae-3df1-4a43-a4fd-5ee5215c4c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c56ddb-28c1-4f97-914c-0a75575de296', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d24c488-5a5b-40f0-ab8f-28d079291c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Creating offline snapshot df84208a-aee7-4189-af53-9d521edc2f68 of volume f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:15:27 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Volume volume-09c56ddb-28c1-4f97-914c-0a75575de296 (09c56ddb-28c1-4f97-914c-0a75575de296): created successfully Apr 15 10:15:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d24c488-5a5b-40f0-ab8f-28d079291c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Flow 'volume_create_manager' (d3240c3c-e183-41c1-9109-c094952bee2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:27 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae4b5f1-624b-440d-991a-3a41f84c44eb]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f5c880c3-190d-49a4-bbd2-337579f57174 tempest-CreateVolumesFromImageTest-1240634869 None] Created volume successfully. Apr 15 10:15:27 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 Apr 15 10:15:27 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:28 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6" returned: 0 in 0.460s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:28 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 1G Apr 15 10:15:28 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "cinder-09c56ddb-28c1-4f97-914c-0a75575de296-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-09c56ddb-28c1-4f97-914c-0a75575de296-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "cinder-quobyte-09c56ddb-28c1-4f97-914c-0a75575de296" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-quobyte-09c56ddb-28c1-4f97-914c-0a75575de296" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:28 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fec1d37-a61c-4abc-8eff-c77c97811ab8]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09c56ddb-28c1-4f97-914c-0a75575de296 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:28 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 1G" returned: 0 in 0.562s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:28 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 Apr 15 10:15:28 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:28 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09c56ddb-28c1-4f97-914c-0a75575de296 Apr 15 10:15:28 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:29 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:29 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68" returned: 0 in 0.429s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:29 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 is being set with open permissions: ugo+rw Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09c56ddb-28c1-4f97-914c-0a75575de296" returned: 0 in 0.479s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09c56ddb-28c1-4f97-914c-0a75575de296 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:29 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 Apr 15 10:15:29 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:29 devstack sudo[90588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09c56ddb-28c1-4f97-914c-0a75575de296 Apr 15 10:15:29 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:29 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68" returned: 0 in 0.427s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:29 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09c56ddb-28c1-4f97-914c-0a75575de296" returned: 0 in 0.434s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-quobyte-09c56ddb-28c1-4f97-914c-0a75575de296" released by "delete_volume" :: held 0.947s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:29 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.info Apr 15 10:15:29 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Created reservations ['62720168-09be-44c0-bade-5f593a15e464', 'd0bc8e5f-06fd-4f20-9715-9475e963b603', '45e22548-9732-49db-a26c-522c087855ca', 'ee822ef7-70c0-48c6-b734-cbb7bad0307a'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:29 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:29 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "cinder-8bf1e57e-6b20-4c17-a75d-8305acb351ab-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-8bf1e57e-6b20-4c17-a75d-8305acb351ab-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "cinder-quobyte-8bf1e57e-6b20-4c17-a75d-8305acb351ab" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-quobyte-8bf1e57e-6b20-4c17-a75d-8305acb351ab" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a3a0e9-e595-4338-8357-7eaba71f1cdd]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:29 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab Apr 15 10:15:29 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:30 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.info" returned: 0 in 0.446s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:30 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.info is being set with open permissions: ugo+rw Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:30 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.info Apr 15 10:15:30 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:30 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.445s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Deleted volume successfully. Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dcee04df-756d-4cfc-9ee9-4f368109b383 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-09c56ddb-28c1-4f97-914c-0a75575de296-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:30 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab" returned: 0 in 0.470s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:30 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab Apr 15 10:15:30 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:30 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.info" returned: 0 in 0.430s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.951s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-112678228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09950081-db3f-4b13-939b-223990efae28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0a8237dec34b6d988a1cd1d3cf22b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:23Z,use_quota=True,user_id='d92c602b5d6a4c8781452967a103c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Creating volume 09950081-db3f-4b13-939b-223990efae28 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:30 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09950081-db3f-4b13-939b-223990efae28 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:30 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09950081-db3f-4b13-939b-223990efae28 1073741824 Apr 15 10:15:30 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-17bf0dba-d5cf-4c3b-8955-5d1edfc7fcf7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Create snapshot completed successfully Apr 15 10:15:30 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-8bf1e57e-6b20-4c17-a75d-8305acb351ab" returned: 0 in 0.463s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-quobyte-8bf1e57e-6b20-4c17-a75d-8305acb351ab" released by "delete_volume" :: held 0.953s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Created reservations ['7e109f7e-33c5-4fed-a527-e9fcff386bee', '25280784-794b-477a-aaa0-b60fcc656824', 'f6896c6a-ec9e-419b-8fe6-85214defeb42', '5f80ae69-07ae-4e4f-9386-a93cba6e485c'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:30 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:30 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "cinder-eff4cf10-7011-47c8-98d1-12ba0257149f-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-eff4cf10-7011-47c8-98d1-12ba0257149f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "cinder-quobyte-eff4cf10-7011-47c8-98d1-12ba0257149f" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-quobyte-eff4cf10-7011-47c8-98d1-12ba0257149f" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed980b37-102c-4455-a167-22189c4a4d26]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-eff4cf10-7011-47c8-98d1-12ba0257149f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:31 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-eff4cf10-7011-47c8-98d1-12ba0257149f Apr 15 10:15:31 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:31 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09950081-db3f-4b13-939b-223990efae28 1073741824" returned: 0 in 0.541s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09950081-db3f-4b13-939b-223990efae28 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:31 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09950081-db3f-4b13-939b-223990efae28 Apr 15 10:15:31 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:31 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.451s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Deleted volume successfully. Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a81cac0f-7412-4f69-a853-f2713ac63b51 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-8bf1e57e-6b20-4c17-a75d-8305acb351ab-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:31 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-eff4cf10-7011-47c8-98d1-12ba0257149f" returned: 0 in 0.503s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-eff4cf10-7011-47c8-98d1-12ba0257149f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:31 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-eff4cf10-7011-47c8-98d1-12ba0257149f Apr 15 10:15:31 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:31 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09950081-db3f-4b13-939b-223990efae28" returned: 0 in 0.455s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.712s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-899378799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec93ebc-5db4-4c62-b73b-faf5ee281d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0a8237dec34b6d988a1cd1d3cf22b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:23Z,use_quota=True,user_id='d92c602b5d6a4c8781452967a103c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Creating volume 0ec93ebc-5db4-4c62-b73b-faf5ee281d33 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:31 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:31 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33 1073741824 Apr 15 10:15:31 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae31d46b-06aa-40d5-a99f-e445211d76db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09950081-db3f-4b13-939b-223990efae28', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df993b1-6b23-4c00-afe1-fd415ff284df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:31 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume volume-09950081-db3f-4b13-939b-223990efae28 (09950081-db3f-4b13-939b-223990efae28): created successfully Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df993b1-6b23-4c00-afe1-fd415ff284df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Flow 'volume_create_manager' (7c41b94f-f437-41b0-b1f1-1f400a5b6c1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e6670e69-d074-4f38-a3c2-926c7de28b63 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Created volume successfully. Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Flow 'volume_create_manager' (06cd8ab6-0b1b-4ae1-abb3-1a57ef4162ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9c36bf-8b53-4a09-a488-a6d33a406aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9c36bf-8b53-4a09-a488-a6d33a406aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-71055961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fe76fbf5494f649cc799ca6efe901e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:32Z,use_quota=True,user_id='f5690a58994a4451b17b9afe3ab5b98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74ee6ba-9ffd-4760-b5e3-071f703402ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74ee6ba-9ffd-4760-b5e3-071f703402ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c02007-b0ba-4ee4-9058-d61059578a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c02007-b0ba-4ee4-9058-d61059578a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b', 'volume_name': 'volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d573eaf9-73ec-470f-89f6-55cbb9687e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d573eaf9-73ec-470f-89f6-55cbb9687e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d10b7e5-10ce-4749-a29f-a7217b28b3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:31 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b', 'volume_size': 1} Apr 15 10:15:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Flow 'volume_create_manager' (d817845d-f3e9-4966-a664-2141b350aa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96bcddc6-0bef-4ea7-acc4-0344eeaed351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96bcddc6-0bef-4ea7-acc4-0344eeaed351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1492957142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db66edf2-a3a8-43b6-8f92-c7b12ad3890c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fe76fbf5494f649cc799ca6efe901e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:32Z,use_quota=True,user_id='f5690a58994a4451b17b9afe3ab5b98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ecbd80-29d6-453a-b3c6-56248196ae0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ecbd80-29d6-453a-b3c6-56248196ae0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4b92b7-264d-43fd-b064-e4ba4caf7aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4b92b7-264d-43fd-b064-e4ba4caf7aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db66edf2-a3a8-43b6-8f92-c7b12ad3890c', 'volume_name': 'volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c65907-8e64-4243-b15b-e030078573c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c65907-8e64-4243-b15b-e030078573c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c95ea32-4882-4fc0-9ce5-b438f83bcd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume db66edf2-a3a8-43b6-8f92-c7b12ad3890c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c', 'volume_size': 1} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-eff4cf10-7011-47c8-98d1-12ba0257149f" returned: 0 in 0.580s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-quobyte-eff4cf10-7011-47c8-98d1-12ba0257149f" released by "delete_volume" :: held 1.107s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:32 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33 1073741824" returned: 0 in 0.542s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Created reservations ['2cd24b77-236c-4ec0-8790-d91adb1ad756', '407fc7fb-84e6-463f-8841-ba0bdbf74f0c', '814a15b0-abc6-4566-88fa-d67b56a5dae0', 'bc507fb8-f933-414a-8bb9-c6c49bbee95f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:32 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33 Apr 15 10:15:32 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:32 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:32 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Flow 'volume_create_manager' (3149fc44-07e2-4601-b57f-7e523cf29a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a08c68-b985-4464-b918-85ac515698f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a08c68-b985-4464-b918-85ac515698f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1493445494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c992096f-34c7-42e5-9798-0e09c37fd835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fe76fbf5494f649cc799ca6efe901e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:32Z,use_quota=True,user_id='f5690a58994a4451b17b9afe3ab5b98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9c88a9-b37c-47e7-8904-a54a0ccebbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9c88a9-b37c-47e7-8904-a54a0ccebbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f2ff2b-6807-4e08-a9c7-e5bde5ef0244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f2ff2b-6807-4e08-a9c7-e5bde5ef0244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c992096f-34c7-42e5-9798-0e09c37fd835', 'volume_name': 'volume-c992096f-34c7-42e5-9798-0e09c37fd835', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ccbd99-fba3-409c-851b-c20d4c1a470e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ccbd99-fba3-409c-851b-c20d4c1a470e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a86bd2d-97bb-4b19-8f83-14f7feb43a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume c992096f-34c7-42e5-9798-0e09c37fd835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c992096f-34c7-42e5-9798-0e09c37fd835', 'volume_size': 1} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Flow 'volume_create_manager' (497fa476-5231-4b09-88df-2022bd1ce3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1294fe01-9cd1-4e0a-af94-e616821ca0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1294fe01-9cd1-4e0a-af94-e616821ca0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2037268190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daedaacd-2a8f-4f7a-afe0-9c5ba03f9168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fe76fbf5494f649cc799ca6efe901e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:32Z,use_quota=True,user_id='f5690a58994a4451b17b9afe3ab5b98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d10fe1-06dc-44b1-9eef-f072abcefa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d10fe1-06dc-44b1-9eef-f072abcefa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42b698d-cfeb-43df-9d4f-2c6dcdd5599c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42b698d-cfeb-43df-9d4f-2c6dcdd5599c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daedaacd-2a8f-4f7a-afe0-9c5ba03f9168', 'volume_name': 'volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02efeb38-01af-4be6-b680-e262506bacba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02efeb38-01af-4be6-b680-e262506bacba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93203a90-182c-4065-9ced-518143ca2f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume daedaacd-2a8f-4f7a-afe0-9c5ba03f9168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168', 'volume_size': 1} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Flow 'volume_create_manager' (e2521085-da30-4095-b0aa-e70fd76cbc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae552dc9-e70d-410f-ad32-583603d3e198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae552dc9-e70d-410f-ad32-583603d3e198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1635751321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead0354a-ff4a-4897-be7e-63b1fa272b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fe76fbf5494f649cc799ca6efe901e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:33Z,use_quota=True,user_id='f5690a58994a4451b17b9afe3ab5b98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3a0547-f9c6-4211-a797-9a09d2f13bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3a0547-f9c6-4211-a797-9a09d2f13bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf02d61-420f-4f86-8322-fa41c516877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf02d61-420f-4f86-8322-fa41c516877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ead0354a-ff4a-4897-be7e-63b1fa272b93', 'volume_name': 'volume-ead0354a-ff4a-4897-be7e-63b1fa272b93', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee6fe86-e9a9-434e-a7b2-7ec3d76f002c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee6fe86-e9a9-434e-a7b2-7ec3d76f002c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be0ece9-4915-41e0-92c8-5c6812fa441f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume ead0354a-ff4a-4897-be7e-63b1fa272b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ead0354a-ff4a-4897-be7e-63b1fa272b93', 'volume_size': 1} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:32 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33" returned: 0 in 0.518s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.685s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:32 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1126019545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c6aac5-b789-4fe8-abfb-ec1d18b7d585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0a8237dec34b6d988a1cd1d3cf22b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:23Z,use_quota=True,user_id='d92c602b5d6a4c8781452967a103c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Creating volume 95c6aac5-b789-4fe8-abfb-ec1d18b7d585 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:32 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Deleted volume successfully. Apr 15 10:15:32 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585 1073741824 Apr 15 10:15:32 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fdc907-0130-4a02-a18b-952c00a6e3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a40e50-7c16-49bb-9ea1-2bbafab863ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33 (0ec93ebc-5db4-4c62-b73b-faf5ee281d33): created successfully Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a40e50-7c16-49bb-9ea1-2bbafab863ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Flow 'volume_create_manager' (09bd2ed8-fa1f-43af-a89c-86f417b181ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cf8cee3a-13cf-4252-afb5-bd21d1acaa08 tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-eff4cf10-7011-47c8-98d1-12ba0257149f-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2cee9f67-afdc-41a6-96b4-01904ba7d8bb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Created volume successfully. Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "cinder-3874df62-69d8-4589-a46e-2bfbc66f2ae9-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-3874df62-69d8-4589-a46e-2bfbc66f2ae9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "cinder-quobyte-3874df62-69d8-4589-a46e-2bfbc66f2ae9" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-quobyte-3874df62-69d8-4589-a46e-2bfbc66f2ae9" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:33 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61ee67a-aa2e-43ce-9149-1f9844ebb034]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585 1073741824" returned: 0 in 0.503s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:33 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585 Apr 15 10:15:33 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:33 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9 Apr 15 10:15:33 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:33 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585" returned: 0 in 0.407s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.332s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135391028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39bebd1-9519-4d41-a029-8b98720bb9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0a8237dec34b6d988a1cd1d3cf22b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:23Z,use_quota=True,user_id='d92c602b5d6a4c8781452967a103c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Creating volume c39bebd1-9519-4d41-a029-8b98720bb9f6 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:33 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c39bebd1-9519-4d41-a029-8b98720bb9f6 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:33 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:33 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c39bebd1-9519-4d41-a029-8b98720bb9f6 1073741824 Apr 15 10:15:33 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cbcb72-88b5-4f30-b7da-e5720824dd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06f385f-b20b-422e-a32e-84f086340379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9" returned: 0 in 0.486s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:33 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585 (95c6aac5-b789-4fe8-abfb-ec1d18b7d585): created successfully Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06f385f-b20b-422e-a32e-84f086340379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Flow 'volume_create_manager' (dff4d14d-37f6-4fd1-93cd-ed2582e5d571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:33 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9 Apr 15 10:15:33 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e481519a-f84a-4d15-81ae-13d7497700e1 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Created volume successfully. Apr 15 10:15:34 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c39bebd1-9519-4d41-a029-8b98720bb9f6 1073741824" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:34 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-3874df62-69d8-4589-a46e-2bfbc66f2ae9" returned: 0 in 0.474s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-quobyte-3874df62-69d8-4589-a46e-2bfbc66f2ae9" released by "delete_volume" :: held 0.998s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c39bebd1-9519-4d41-a029-8b98720bb9f6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:34 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c39bebd1-9519-4d41-a029-8b98720bb9f6 Apr 15 10:15:34 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Created reservations ['a2f89b0e-51c6-4c0c-8b90-24aed2aeba92', 'ac336c80-3327-4680-b609-3052549e9bdd', '8ff67834-5b51-4b83-9547-c8dfdb061890', '6140f8a8-1014-4466-a404-1747897f7698'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:34 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:34 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:34 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c39bebd1-9519-4d41-a029-8b98720bb9f6" returned: 0 in 0.441s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.137s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2030971208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a07ee48-12e3-4df8-b0aa-b6e729ec232c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0a8237dec34b6d988a1cd1d3cf22b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:23Z,use_quota=True,user_id='d92c602b5d6a4c8781452967a103c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Creating volume 5a07ee48-12e3-4df8-b0aa-b6e729ec232c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:34 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:34 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c 1073741824 Apr 15 10:15:34 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af79d50-4e02-4231-abf1-e699cbafc77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c39bebd1-9519-4d41-a029-8b98720bb9f6', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:34 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae303ea-4ac7-4746-931b-c1d3f1ec56fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.415s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Deleted volume successfully. Apr 15 10:15:34 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume volume-c39bebd1-9519-4d41-a029-8b98720bb9f6 (c39bebd1-9519-4d41-a029-8b98720bb9f6): created successfully Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae303ea-4ac7-4746-931b-c1d3f1ec56fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Flow 'volume_create_manager' (f6d64bb7-2056-4ec9-bbb8-73fb105c9389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6550bb5a-2b86-4d5a-a372-618583e1c2d0 tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Created volume successfully. Apr 15 10:15:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-72b25ced-0bd1-43b5-af21-ea046d96f93e tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-3874df62-69d8-4589-a46e-2bfbc66f2ae9-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:35 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c 1073741824" returned: 0 in 0.451s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:35 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c Apr 15 10:15:35 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "cinder-7ec92f6f-1358-4a9c-9730-e58dca9753a1-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-7ec92f6f-1358-4a9c-9730-e58dca9753a1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "cinder-quobyte-7ec92f6f-1358-4a9c-9730-e58dca9753a1" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-quobyte-7ec92f6f-1358-4a9c-9730-e58dca9753a1" acquired by "delete_volume" :: waited 0.006s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5df76f-f02b-4f5f-a71a-4bb800162ae0]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:35 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1 Apr 15 10:15:35 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:35 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c" returned: 0 in 0.451s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.100s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] Creating offline snapshot c075892f-421f-4f3c-bf87-7ab4c57f6ee9 of volume d744f513-6b81-4e24-a821-aed5d87248bc {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc100c23-5f1a-4efa-9d0e-43768059db25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6fd606-0739-45e1-8e28-cc154c1b1bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[458865f9-f690-4dd9-bd3f-3d6d7f4dde4a]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:35 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Volume volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c (5a07ee48-12e3-4df8-b0aa-b6e729ec232c): created successfully Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6fd606-0739-45e1-8e28-cc154c1b1bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Flow 'volume_create_manager' (331a60d0-b7d0-4c63-96ff-1c91502fdd73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:35 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6216bd5b-f249-4c25-b07e-4ee2f74e3e2e tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Created volume successfully. Apr 15 10:15:35 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc Apr 15 10:15:35 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:35 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1" returned: 0 in 0.495s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:35 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1 Apr 15 10:15:35 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:36 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc" returned: 0 in 0.525s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:36 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 1G Apr 15 10:15:36 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "cinder-5a07ee48-12e3-4df8-b0aa-b6e729ec232c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-5a07ee48-12e3-4df8-b0aa-b6e729ec232c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:36 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "cinder-quobyte-5a07ee48-12e3-4df8-b0aa-b6e729ec232c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-7ec92f6f-1358-4a9c-9730-e58dca9753a1" returned: 0 in 0.478s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-quobyte-7ec92f6f-1358-4a9c-9730-e58dca9753a1" released by "delete_volume" :: held 0.993s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-quobyte-5a07ee48-12e3-4df8-b0aa-b6e729ec232c" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a539b53-babd-418c-9926-db3960566af7]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Created reservations ['5108f321-22bc-4afa-aa01-0b9ebffb4a34', '1f4786ac-1afc-472a-b45c-9c6e74e25a87', '646a91ec-95d8-466f-8a79-cfa6f7643775', '8765748c-f16b-49e6-a325-3646ba0ed4f1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:36 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c Apr 15 10:15:36 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:36 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:36 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:36 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 1G" returned: 0 in 0.511s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d744f513-6b81-4e24-a821-aed5d87248bc -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:36 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d744f513-6b81-4e24-a821-aed5d87248bc -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 Apr 15 10:15:36 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:36 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.413s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:36 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Deleted volume successfully. Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a2666c3d-9269-406a-8121-d030b9d373ff tempest-CreateVolumesFromImageTest-1240634869 None] Lock "cinder-7ec92f6f-1358-4a9c-9730-e58dca9753a1-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:36 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:36 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c Apr 15 10:15:36 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:37 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d744f513-6b81-4e24-a821-aed5d87248bc -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9" returned: 0 in 0.487s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:37 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 is being set with open permissions: ugo+rw Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:37 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 Apr 15 10:15:37 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:37 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5a07ee48-12e3-4df8-b0aa-b6e729ec232c" returned: 0 in 0.402s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-quobyte-5a07ee48-12e3-4df8-b0aa-b6e729ec232c" released by "delete_volume" :: held 0.968s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Created reservations ['5566e988-0576-4018-adc6-e53b868791a9', '85e7047d-d313-49c1-937e-aef869092a14', '140ef49b-fdcf-44c6-a138-c3d985f90f2a', '9e7ea42f-dcfc-4ec4-91d7-fef88197670e'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:37 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:37 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:37 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9" returned: 0 in 0.456s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:37 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.info Apr 15 10:15:37 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:37 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:37 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:37 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:37 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Deleted volume successfully. Apr 15 10:15:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dd8a6d23-a9b0-40cc-902f-c5583a87495c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-5a07ee48-12e3-4df8-b0aa-b6e729ec232c-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:38 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.info" returned: 0 in 0.499s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:38 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.info is being set with open permissions: ugo+rw Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:38 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.info Apr 15 10:15:38 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:38 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.459s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "cinder-c39bebd1-9519-4d41-a029-8b98720bb9f6-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-c39bebd1-9519-4d41-a029-8b98720bb9f6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "cinder-quobyte-c39bebd1-9519-4d41-a029-8b98720bb9f6" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-quobyte-c39bebd1-9519-4d41-a029-8b98720bb9f6" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac90578-c90d-4fb0-97ba-abfa94adba1d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c39bebd1-9519-4d41-a029-8b98720bb9f6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:38 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c39bebd1-9519-4d41-a029-8b98720bb9f6 Apr 15 10:15:38 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:38 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.info" returned: 0 in 0.526s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.074s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.810s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-71055961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fe76fbf5494f649cc799ca6efe901e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:32Z,use_quota=True,user_id='f5690a58994a4451b17b9afe3ab5b98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Creating volume b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:38 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:38 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b 1073741824 Apr 15 10:15:38 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:38 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-990fbec9-8b63-4e4d-999e-08c9f4441944 tempest-VolumeDependencyTests-1062553553 None] Create snapshot completed successfully Apr 15 10:15:39 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c39bebd1-9519-4d41-a029-8b98720bb9f6" returned: 0 in 0.593s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c39bebd1-9519-4d41-a029-8b98720bb9f6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:39 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c39bebd1-9519-4d41-a029-8b98720bb9f6 Apr 15 10:15:39 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Flow 'volume_create_manager' (0e61899f-d55b-4398-b6fa-d080673f6f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776acb6c-534b-49ed-a974-0c2ac6d5ddeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776acb6c-534b-49ed-a974-0c2ac6d5ddeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-177855893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ca60de4f1a84d94baf109cd7e3798c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c075892f-421f-4f3c-bf87-7ab4c57f6ee9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:39Z,use_quota=True,user_id='55b46c4a7ba14a9c97023b6d654a81ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf572cb-fb24-4778-9025-dfcdbeaa08ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf572cb-fb24-4778-9025-dfcdbeaa08ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918ea275-0c6e-475d-a5f3-c915cfe9b2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918ea275-0c6e-475d-a5f3-c915cfe9b2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5', 'volume_name': 'volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5', 'volume_size': 1, 'snapshot_id': 'c075892f-421f-4f3c-bf87-7ab4c57f6ee9'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c0d1d5-ec7c-4362-bd9f-65942d8c4b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c0d1d5-ec7c-4362-bd9f-65942d8c4b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb91e8d9-a4a2-4a4d-96ee-6b35afa66f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Volume e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5', 'volume_size': 1, 'snapshot_id': 'c075892f-421f-4f3c-bf87-7ab4c57f6ee9'} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:39 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b 1073741824" returned: 0 in 0.691s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:39 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b Apr 15 10:15:39 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:39 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c39bebd1-9519-4d41-a029-8b98720bb9f6" returned: 0 in 0.478s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-quobyte-c39bebd1-9519-4d41-a029-8b98720bb9f6" released by "delete_volume" :: held 1.092s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Created reservations ['9d8b478a-a82a-48b2-bc8b-3cdacce44f15', '4c4b091f-b21d-4d51-8e52-fbf798d5dcf9', 'd362f9ea-bcf2-48c4-a785-0fdaa992836d', 'abea3a5c-d290-4e35-b89c-cb3bf65dd066'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:39 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:39 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:39 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b" returned: 0 in 0.458s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.741s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1492957142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db66edf2-a3a8-43b6-8f92-c7b12ad3890c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fe76fbf5494f649cc799ca6efe901e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:32Z,use_quota=True,user_id='f5690a58994a4451b17b9afe3ab5b98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Creating volume db66edf2-a3a8-43b6-8f92-c7b12ad3890c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:39 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d10b7e5-10ce-4749-a29f-a7217b28b3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c 1073741824 Apr 15 10:15:39 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ecb318-f97b-497c-9718-e365cb48dc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b (b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b): created successfully Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ecb318-f97b-497c-9718-e365cb48dc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Flow 'volume_create_manager' (06cd8ab6-0b1b-4ae1-abb3-1a57ef4162ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:39 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-110ba840-21af-41c7-b9d6-1027496963a7 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Created volume successfully. Apr 15 10:15:40 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.474s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:40 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:40 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Deleted volume successfully. Apr 15 10:15:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-644cc9b7-1b1c-4304-a691-f0192993fa1f tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-c39bebd1-9519-4d41-a029-8b98720bb9f6-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:40 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c 1073741824" returned: 0 in 0.598s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:40 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c Apr 15 10:15:40 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "cinder-95c6aac5-b789-4fe8-abfb-ec1d18b7d585-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-95c6aac5-b789-4fe8-abfb-ec1d18b7d585-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "cinder-quobyte-95c6aac5-b789-4fe8-abfb-ec1d18b7d585" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-quobyte-95c6aac5-b789-4fe8-abfb-ec1d18b7d585" acquired by "delete_volume" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:40 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2271e58-9f5b-4f23-8a49-0e8c827a8c41]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:40 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585 Apr 15 10:15:40 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:41 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c" returned: 0 in 0.510s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.682s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1493445494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c992096f-34c7-42e5-9798-0e09c37fd835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fe76fbf5494f649cc799ca6efe901e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:32Z,use_quota=True,user_id='f5690a58994a4451b17b9afe3ab5b98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Creating volume c992096f-34c7-42e5-9798-0e09c37fd835 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:41 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c992096f-34c7-42e5-9798-0e09c37fd835 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c95ea32-4882-4fc0-9ce5-b438f83bcd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:41 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c992096f-34c7-42e5-9798-0e09c37fd835 1073741824 Apr 15 10:15:41 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f29dd94-056f-4cbf-b89a-eb5e27d2e50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:41 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c (db66edf2-a3a8-43b6-8f92-c7b12ad3890c): created successfully Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f29dd94-056f-4cbf-b89a-eb5e27d2e50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Flow 'volume_create_manager' (d817845d-f3e9-4966-a664-2141b350aa0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:41 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-160127bc-f69d-4931-a358-fbe8287b22fc tempest-CreateVolumesFromSnapshotTest-1591415377 None] Created volume successfully. Apr 15 10:15:41 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585" returned: 0 in 0.523s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:41 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585 Apr 15 10:15:41 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:41 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c992096f-34c7-42e5-9798-0e09c37fd835 1073741824" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c992096f-34c7-42e5-9798-0e09c37fd835 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:41 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c992096f-34c7-42e5-9798-0e09c37fd835 Apr 15 10:15:41 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:41 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-95c6aac5-b789-4fe8-abfb-ec1d18b7d585" returned: 0 in 0.481s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-quobyte-95c6aac5-b789-4fe8-abfb-ec1d18b7d585" released by "delete_volume" :: held 1.051s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Created reservations ['f28f6c27-78ce-4d28-a368-54e7974f6a53', '51800b86-206a-4c9d-9d33-f6d47d160f9f', '0579514a-d4d1-46bc-94d6-480ea58bc8f8', 'c29098fa-d6ba-4e3b-b83b-da7d1ee50c83'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:41 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:41 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:42 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c992096f-34c7-42e5-9798-0e09c37fd835" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.559s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2037268190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daedaacd-2a8f-4f7a-afe0-9c5ba03f9168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fe76fbf5494f649cc799ca6efe901e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:32Z,use_quota=True,user_id='f5690a58994a4451b17b9afe3ab5b98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Creating volume daedaacd-2a8f-4f7a-afe0-9c5ba03f9168 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:42 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a86bd2d-97bb-4b19-8f83-14f7feb43a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c992096f-34c7-42e5-9798-0e09c37fd835', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71847053-bce8-4104-9fa6-27740a7a7ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:42 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168 1073741824 Apr 15 10:15:42 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:42 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume volume-c992096f-34c7-42e5-9798-0e09c37fd835 (c992096f-34c7-42e5-9798-0e09c37fd835): created successfully Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71847053-bce8-4104-9fa6-27740a7a7ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Flow 'volume_create_manager' (3149fc44-07e2-4601-b57f-7e523cf29a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:42 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-edbe9a25-0672-4648-9d04-c7e8edada5ea tempest-CreateVolumesFromSnapshotTest-1591415377 None] Created volume successfully. Apr 15 10:15:42 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.448s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:42 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Deleted volume successfully. Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-76f7e049-78c5-4cb7-80f8-7714a819d34c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-95c6aac5-b789-4fe8-abfb-ec1d18b7d585-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:42 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168 1073741824" returned: 0 in 0.547s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:42 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168 Apr 15 10:15:42 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "cinder-0ec93ebc-5db4-4c62-b73b-faf5ee281d33-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-0ec93ebc-5db4-4c62-b73b-faf5ee281d33-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "cinder-quobyte-0ec93ebc-5db4-4c62-b73b-faf5ee281d33" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-quobyte-0ec93ebc-5db4-4c62-b73b-faf5ee281d33" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e181089-3bf7-4866-8154-efac33135e1b]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:43 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33 Apr 15 10:15:43 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:43 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168" returned: 0 in 0.474s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.458s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1635751321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead0354a-ff4a-4897-be7e-63b1fa272b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fe76fbf5494f649cc799ca6efe901e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:33Z,use_quota=True,user_id='f5690a58994a4451b17b9afe3ab5b98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Creating volume ead0354a-ff4a-4897-be7e-63b1fa272b93 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:43 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ead0354a-ff4a-4897-be7e-63b1fa272b93 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93203a90-182c-4065-9ced-518143ca2f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd4d688-914e-473e-9761-ee13ca298ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:43 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ead0354a-ff4a-4897-be7e-63b1fa272b93 1073741824 Apr 15 10:15:43 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:43 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168 (daedaacd-2a8f-4f7a-afe0-9c5ba03f9168): created successfully Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd4d688-914e-473e-9761-ee13ca298ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Flow 'volume_create_manager' (497fa476-5231-4b09-88df-2022bd1ce3fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:43 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-322e4596-15ae-465e-8ea8-5b3394eac667 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Created volume successfully. Apr 15 10:15:43 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33" returned: 0 in 0.558s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:43 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33 Apr 15 10:15:43 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:43 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ead0354a-ff4a-4897-be7e-63b1fa272b93 1073741824" returned: 0 in 0.652s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ead0354a-ff4a-4897-be7e-63b1fa272b93 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:43 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ead0354a-ff4a-4897-be7e-63b1fa272b93 Apr 15 10:15:43 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:44 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0ec93ebc-5db4-4c62-b73b-faf5ee281d33" returned: 0 in 0.485s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-quobyte-0ec93ebc-5db4-4c62-b73b-faf5ee281d33" released by "delete_volume" :: held 1.069s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Created reservations ['5ac1bfbe-62a0-466a-b99e-3ac60c07f84b', 'f12dc76f-2181-4892-a43e-4d82284cb939', 'f5bb8408-e120-4deb-82fd-26433263e133', 'ff3368b6-d360-4d98-bb7c-beec4c132101'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:44 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:44 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:44 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ead0354a-ff4a-4897-be7e-63b1fa272b93" returned: 0 in 0.494s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.975s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-quobyte-c075892f-421f-4f3c-bf87-7ab4c57f6ee9-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be0ece9-4915-41e0-92c8-5c6812fa441f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ead0354a-ff4a-4897-be7e-63b1fa272b93', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bef52a5-8457-4ef8-9ed9-05bcb90f0351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:44 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Volume volume-ead0354a-ff4a-4897-be7e-63b1fa272b93 (ead0354a-ff4a-4897-be7e-63b1fa272b93): created successfully Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bef52a5-8457-4ef8-9ed9-05bcb90f0351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Flow 'volume_create_manager' (e2521085-da30-4095-b0aa-e70fd76cbc44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-c075892f-421f-4f3c-bf87-7ab4c57f6ee9-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Creating volume e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5 from snapshot c075892f-421f-4f3c-bf87-7ab4c57f6ee9 {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-quobyte-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-507164df-fa56-456c-b633-3c215a1b4285 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Created volume successfully. Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] snapshot: c075892f-421f-4f3c-bf87-7ab4c57f6ee9, volume: e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d097e4-f45e-4e41-a229-3b6de8ed3844]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:44 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 Apr 15 10:15:44 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-ead0354a-ff4a-4897-be7e-63b1fa272b93-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-ead0354a-ff4a-4897-be7e-63b1fa272b93-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-quobyte-ead0354a-ff4a-4897-be7e-63b1fa272b93" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-ead0354a-ff4a-4897-be7e-63b1fa272b93" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f098f9e-7ac8-4fa5-b9d1-9c5aa2f6db5d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ead0354a-ff4a-4897-be7e-63b1fa272b93 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:44 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ead0354a-ff4a-4897-be7e-63b1fa272b93 Apr 15 10:15:44 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:44 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.622s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Deleted volume successfully. Apr 15 10:15:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-005901df-3d2d-4b0e-8330-ffe59cd0179b tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-0ec93ebc-5db4-4c62-b73b-faf5ee281d33-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:45 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9" returned: 0 in 0.643s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d744f513-6b81-4e24-a821-aed5d87248bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] will copy from snapshot at /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5498bef3-7379-4596-ad7f-329df6a37c66]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "cinder-09950081-db3f-4b13-939b-223990efae28-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-09950081-db3f-4b13-939b-223990efae28-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:45 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "cinder-quobyte-09950081-db3f-4b13-939b-223990efae28" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ead0354a-ff4a-4897-be7e-63b1fa272b93" returned: 0 in 0.547s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ead0354a-ff4a-4897-be7e-63b1fa272b93 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:45 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc Apr 15 10:15:45 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-quobyte-09950081-db3f-4b13-939b-223990efae28" acquired by "delete_volume" :: waited 0.030s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:45 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ead0354a-ff4a-4897-be7e-63b1fa272b93 Apr 15 10:15:45 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b46f7dc-5938-4175-a34e-1c01e54d0fc4]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09950081-db3f-4b13-939b-223990efae28 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:45 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09950081-db3f-4b13-939b-223990efae28 Apr 15 10:15:45 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:45 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-ead0354a-ff4a-4897-be7e-63b1fa272b93" returned: 0 in 0.579s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-ead0354a-ff4a-4897-be7e-63b1fa272b93" released by "delete_volume" :: held 1.156s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Created reservations ['5c352c67-681b-49f6-8878-3c9712c4ed93', '0499fe9c-8367-4ece-9960-96ffe4d3f984', '1afabc7a-2a51-4bf7-918f-e5412d70a838', 'c609a39a-a192-445b-ab10-201c4686969d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:45 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc" returned: 0 in 0.778s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Path /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:45 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5 Apr 15 10:15:45 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:45 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:45 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:46 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09950081-db3f-4b13-939b-223990efae28" returned: 0 in 0.772s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09950081-db3f-4b13-939b-223990efae28 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:46 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09950081-db3f-4b13-939b-223990efae28 Apr 15 10:15:46 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:46 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.545s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Deleted volume successfully. Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-133e35eb-a7ac-4f17-8a39-5b23bd3bb853 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-ead0354a-ff4a-4897-be7e-63b1fa272b93-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:46 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-09950081-db3f-4b13-939b-223990efae28" returned: 0 in 0.515s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-quobyte-09950081-db3f-4b13-939b-223990efae28" released by "delete_volume" :: held 1.321s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Created reservations ['28794e13-c9c9-4ae6-b365-5327176a4340', '6c0ef8f1-d00d-4a4c-9060-e4855d4a7a0a', 'fbc8fd7c-431f-4f94-a139-73c0b5cc61ea', 'a6278c82-fb0b-4d16-ba98-8accdc4a2f9f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:46 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:46 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-quobyte-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168" acquired by "delete_volume" :: waited 0.033s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:47 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbb4b53-1828-4754-9634-cc82f2f6da13]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:47 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168 Apr 15 10:15:47 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "cinder-b5af5a03-ff09-442b-bd39-9cf647fdf334-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-b5af5a03-ff09-442b-bd39-9cf647fdf334-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "cinder-quobyte-b5af5a03-ff09-442b-bd39-9cf647fdf334" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-quobyte-b5af5a03-ff09-442b-bd39-9cf647fdf334" acquired by "delete_volume" :: waited 0.036s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:47 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c5d847-b854-4c87-a87f-12166c65734d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5af5a03-ff09-442b-bd39-9cf647fdf334 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:48 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5af5a03-ff09-442b-bd39-9cf647fdf334 Apr 15 10:15:48 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:48 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5" returned: 0 in 2.707s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:48 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[db547751-d240-4d65-9080-8d6849d95861]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:48 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc Apr 15 10:15:48 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:48 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.987s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:48 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Deleted volume successfully. Apr 15 10:15:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b40d9c77-b494-457a-8f67-ee6a81800d2c tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-09950081-db3f-4b13-939b-223990efae28-delete_volume" released by "delete_volume" :: held 3.569s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:48 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168" returned: 0 in 1.775s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:48 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168 Apr 15 10:15:48 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:49 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5af5a03-ff09-442b-bd39-9cf647fdf334" returned: 0 in 1.150s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5af5a03-ff09-442b-bd39-9cf647fdf334 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:49 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5af5a03-ff09-442b-bd39-9cf647fdf334 Apr 15 10:15:49 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:49 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168" returned: 0 in 0.446s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168" released by "delete_volume" :: held 2.265s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:49 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc" returned: 0 in 0.804s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc, size 1024.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:15:49 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Converted 1024.00 MB image at 378.11 MB/s Apr 15 10:15:49 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5 is being set with open permissions: ugo+rw Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Created reservations ['db14de65-626b-438f-8222-961af5329fcb', 'a0756f02-54ef-4d99-98c9-e8d1d757e901', 'e327e484-22cf-4caa-a0ec-5e9480cc0bde', 'f0b79848-641e-4f7c-aa7d-da0559e0a634'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:49 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5 Apr 15 10:15:49 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:49 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:49 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:49 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b5af5a03-ff09-442b-bd39-9cf647fdf334" returned: 0 in 0.498s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-quobyte-b5af5a03-ff09-442b-bd39-9cf647fdf334" released by "delete_volume" :: held 1.695s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Created reservations ['b4b2c4ac-edab-4b6d-bd31-55e8141e846d', '232e10da-1a15-42ea-88ff-19c580cc4098', '42b4fb7f-0222-4c6d-9e57-7f51429b8d0b', '73dc0725-c3f8-4e29-8998-1f1849a2a56a'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:49 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:49 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:49 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5" returned: 0 in 0.491s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5" released by "_copy_volume_from_snapshot" :: held 5.492s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-c075892f-421f-4f3c-bf87-7ab4c57f6ee9-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5" released by "_create_volume_from_snapshot" :: held 5.525s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.572s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb91e8d9-a4a2-4a4d-96ee-6b35afa66f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5', 'volume_size': 1, 'snapshot_id': 'c075892f-421f-4f3c-bf87-7ab4c57f6ee9'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61b370b-2fe9-4d8a-8253-01aa48610dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:49 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Volume volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5 (e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5): created successfully Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61b370b-2fe9-4d8a-8253-01aa48610dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Flow 'volume_create_manager' (0e61899f-d55b-4398-b6fa-d080673f6f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:49 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-256b531d-fe0f-4aae-bb7c-93eb60223ca2 tempest-VolumeDependencyTests-1062553553 None] Created volume successfully. Apr 15 10:15:50 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.553s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:50 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Deleted volume successfully. Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb71848f-491e-476d-b10f-33ef113acca4 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-daedaacd-2a8f-4f7a-afe0-9c5ba03f9168-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-c075892f-421f-4f3c-bf87-7ab4c57f6ee9-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-c075892f-421f-4f3c-bf87-7ab4c57f6ee9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-quobyte-d744f513-6b81-4e24-a821-aed5d87248bc" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-d744f513-6b81-4e24-a821-aed5d87248bc" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-quobyte-c075892f-421f-4f3c-bf87-7ab4c57f6ee9" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-c075892f-421f-4f3c-bf87-7ab4c57f6ee9" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Deleting offline snapshot c075892f-421f-4f3c-bf87-7ab4c57f6ee9 of volume d744f513-6b81-4e24-a821-aed5d87248bc {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] snapshot_file for this snap is: volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4659dea-b7ba-448b-9924-9a0a50e98da3]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:50 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.557s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:50 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 Apr 15 10:15:50 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:50 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Deleted volume successfully. Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bfdcbfa8-b481-45ca-b2b3-2f8afcdd2bfb tempest-CreateVolumesFromSourceVolumeTest-1241603362 None] Lock "cinder-b5af5a03-ff09-442b-bd39-9cf647fdf334-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-c992096f-34c7-42e5-9798-0e09c37fd835-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-c992096f-34c7-42e5-9798-0e09c37fd835-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-quobyte-c992096f-34c7-42e5-9798-0e09c37fd835" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-c992096f-34c7-42e5-9798-0e09c37fd835" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e044059-b329-4827-9a10-d07ee75f4ce5]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c992096f-34c7-42e5-9798-0e09c37fd835 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:50 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c992096f-34c7-42e5-9798-0e09c37fd835 Apr 15 10:15:50 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:50 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9" returned: 0 in 0.675s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d744f513-6b81-4e24-a821-aed5d87248bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f5ab2f-c908-41c1-acbc-98c265dbc20d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:50 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc Apr 15 10:15:50 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:51 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c992096f-34c7-42e5-9798-0e09c37fd835" returned: 0 in 0.651s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c992096f-34c7-42e5-9798-0e09c37fd835 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:51 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c992096f-34c7-42e5-9798-0e09c37fd835 Apr 15 10:15:51 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:51 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc" returned: 0 in 0.572s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:51 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 Apr 15 10:15:51 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:51 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-c992096f-34c7-42e5-9798-0e09c37fd835" returned: 0 in 0.528s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-c992096f-34c7-42e5-9798-0e09c37fd835" released by "delete_volume" :: held 1.225s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:51 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Created reservations ['8116ae9b-a97c-4e9b-a421-3eb8fe44990a', '20211523-45c1-47b6-a016-e5417a83f62a', '1c032efd-21a3-432e-b862-e7005cf052a0', '24b71603-80e8-4d3b-9f05-d3e3cfe92c10'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:51 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:51 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:52 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9" returned: 0 in 0.579s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:52 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9 Apr 15 10:15:52 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Flow 'volume_create_manager' (55c1a5bf-c219-4531-a8f3-a133f4ff6c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e5b641-bb9d-4285-aaf2-ae3a49b5f677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e5b641-bb9d-4285-aaf2-ae3a49b5f677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8e7b0e-fe64-4116-bc75-430bef5b97b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f3838869d0b443ab61f942f62613668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:52Z,use_quota=True,user_id='aa46942fca984cdd9f76b05f55f4a0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4890a0-f72f-4871-8b74-5d27ac62ece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4890a0-f72f-4871-8b74-5d27ac62ece5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1725086a-e607-42b0-be13-8a6a0d6bd609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1725086a-e607-42b0-be13-8a6a0d6bd609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e8e7b0e-fe64-4116-bc75-430bef5b97b4', 'volume_name': 'volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6f2b04-8f63-48cf-b096-ec9f2d8c7a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6f2b04-8f63-48cf-b096-ec9f2d8c7a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ecc0cd-3919-4e7c-92d5-64feb97f18cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:52 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Volume 6e8e7b0e-fe64-4116-bc75-430bef5b97b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4', 'volume_size': 1} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8e7b0e-fe64-4116-bc75-430bef5b97b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f3838869d0b443ab61f942f62613668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:52Z,use_quota=True,user_id='aa46942fca984cdd9f76b05f55f4a0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Creating volume 6e8e7b0e-fe64-4116-bc75-430bef5b97b4 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:52 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:52 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4 1073741824 Apr 15 10:15:52 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:52 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.514s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:52 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Deleted volume successfully. Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6ffd2f17-ecca-4a2b-ad3f-fd5dabdedcdb tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-c992096f-34c7-42e5-9798-0e09c37fd835-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:52 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc.c075892f-421f-4f3c-bf87-7ab4c57f6ee9" returned: 0 in 0.538s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-c075892f-421f-4f3c-bf87-7ab4c57f6ee9" released by "_delete_snapshot" :: held 2.422s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-d744f513-6b81-4e24-a821-aed5d87248bc" released by "delete_snapshot" :: held 2.438s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Created reservations ['691f4d48-b8e9-4f97-87c4-b818ad6b722e', 'e6461c56-e377-4597-aa80-e89c847c1e10', 'd352576f-bfcb-4bc9-bd85-087736ae4563', '40f75268-6266-4de8-a30a-4fd353e73efa'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-db66edf2-a3a8-43b6-8f92-c7b12ad3890c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-db66edf2-a3a8-43b6-8f92-c7b12ad3890c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:52 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Delete snapshot completed successfully. Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-quobyte-db66edf2-a3a8-43b6-8f92-c7b12ad3890c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c397d7b-3a3c-42c4-a29f-fdfacfa678e7 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-c075892f-421f-4f3c-bf87-7ab4c57f6ee9-delete_snapshot" released by "delete_snapshot" :: held 2.622s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-db66edf2-a3a8-43b6-8f92-c7b12ad3890c" acquired by "delete_volume" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca135c87-1e01-4c3a-83b1-a358d47cd300]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:52 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4 1073741824" returned: 0 in 0.623s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:52 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c Apr 15 10:15:52 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:52 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4 Apr 15 10:15:52 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:53 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4" returned: 0 in 0.420s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ecc0cd-3919-4e7c-92d5-64feb97f18cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1848d696-96d2-43b3-97e5-99612e51b881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:53 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Volume volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4 (6e8e7b0e-fe64-4116-bc75-430bef5b97b4): created successfully Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1848d696-96d2-43b3-97e5-99612e51b881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Flow 'volume_create_manager' (55c1a5bf-c219-4531-a8f3-a133f4ff6c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:53 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c8412b4f-14f5-491c-9016-12a0194f3208 tempest-CinderUnicodeTest-1571294884 None] Created volume successfully. Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-d744f513-6b81-4e24-a821-aed5d87248bc-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-d744f513-6b81-4e24-a821-aed5d87248bc-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:53 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-quobyte-d744f513-6b81-4e24-a821-aed5d87248bc" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c" returned: 0 in 0.622s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-d744f513-6b81-4e24-a821-aed5d87248bc" acquired by "delete_volume" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:53 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c Apr 15 10:15:53 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6031c2-1416-4691-b735-0e5d33bfade0]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:53 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc Apr 15 10:15:53 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:53 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-db66edf2-a3a8-43b6-8f92-c7b12ad3890c" returned: 0 in 0.453s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-db66edf2-a3a8-43b6-8f92-c7b12ad3890c" released by "delete_volume" :: held 1.098s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Created reservations ['bb373976-674d-455a-b833-994b8286e0f3', 'aec73095-1050-409f-b8c5-71b84e09982f', '91e54274-8fd2-429b-aa6e-4d424764c775', '34cd48ae-a0ef-459b-950f-a65118a13a2b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:53 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:53 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:54 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc" returned: 0 in 0.620s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:54 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc Apr 15 10:15:54 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:54 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-d744f513-6b81-4e24-a821-aed5d87248bc" returned: 0 in 0.523s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-d744f513-6b81-4e24-a821-aed5d87248bc" released by "delete_volume" :: held 1.186s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Created reservations ['b554a9e9-4905-42fd-befe-7f6d2e23923a', '3859441a-ba83-43ed-a909-14875bce70cd', '9a532325-7509-4068-ac64-f8cf621d8c72', '0efd7edc-aeb8-47da-935d-e9d0fbbfec5a'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:54 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:54 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:54 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.816s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Flow 'volume_create_manager' (ed73ccff-17b2-41e3-a8af-579f34d6aa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc0108a-4fae-4167-9a99-be520fa45c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:54 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Deleted volume successfully. Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc0108a-4fae-4167-9a99-be520fa45c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1232730375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fca32b8-bc2d-4fe2-a761-089a12fd886c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f3838869d0b443ab61f942f62613668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:55Z,use_quota=True,user_id='aa46942fca984cdd9f76b05f55f4a0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa428450-2bac-432c-bbe0-5dd438f66bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa428450-2bac-432c-bbe0-5dd438f66bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd7e80c-0591-49a0-8f2e-be8d6dbc2627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd7e80c-0591-49a0-8f2e-be8d6dbc2627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fca32b8-bc2d-4fe2-a761-089a12fd886c', 'volume_name': 'volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151a4169-21e8-4843-9fa0-18a934159066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151a4169-21e8-4843-9fa0-18a934159066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f9aa9d-ea97-4ce6-8c20-98a8936973db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:54 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Volume 0fca32b8-bc2d-4fe2-a761-089a12fd886c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c', 'volume_size': 1} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1232730375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fca32b8-bc2d-4fe2-a761-089a12fd886c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f3838869d0b443ab61f942f62613668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:55Z,use_quota=True,user_id='aa46942fca984cdd9f76b05f55f4a0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Creating volume 0fca32b8-bc2d-4fe2-a761-089a12fd886c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:54 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ba4ffd13-c1a8-4d5b-91a7-54f0b7b6feff tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-db66edf2-a3a8-43b6-8f92-c7b12ad3890c-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-quobyte-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:54 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c 1073741824 Apr 15 10:15:54 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c40399-945d-4b31-bf9a-ef8b43b5f169]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:55 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b Apr 15 10:15:55 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:55 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.561s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:55 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Deleted volume successfully. Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-12e60aed-5c52-4f89-8f23-5c6d8ce3880e tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-d744f513-6b81-4e24-a821-aed5d87248bc-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:55 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b" returned: 0 in 0.789s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:55 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b Apr 15 10:15:55 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:55 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c 1073741824" returned: 0 in 0.928s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Flow 'volume_create_manager' (c1e8b70d-835e-4ee6-b756-97cea5810fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95e17e2-b1eb-43e7-900a-c1873c6da7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95e17e2-b1eb-43e7-900a-c1873c6da7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-988161573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5896dc29-1b42-47e5-afd7-ec89496aed0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ca60de4f1a84d94baf109cd7e3798c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:56Z,use_quota=True,user_id='55b46c4a7ba14a9c97023b6d654a81ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba738b97-fc81-41f6-8474-28214232b72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba738b97-fc81-41f6-8474-28214232b72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903c0538-f6a0-48bf-9931-1cb8be2f701f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903c0538-f6a0-48bf-9931-1cb8be2f701f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5896dc29-1b42-47e5-afd7-ec89496aed0a', 'volume_name': 'volume-5896dc29-1b42-47e5-afd7-ec89496aed0a', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25998f19-5bdf-4a6b-9cd2-0e2f09dcc48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25998f19-5bdf-4a6b-9cd2-0e2f09dcc48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cab595a-36fc-42f0-b119-a17a63e880da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:55 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Volume 5896dc29-1b42-47e5-afd7-ec89496aed0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5896dc29-1b42-47e5-afd7-ec89496aed0a', 'volume_size': 1} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:55 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c Apr 15 10:15:55 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:56 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b" returned: 0 in 0.520s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b" released by "delete_volume" :: held 1.356s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Created reservations ['554b6d51-f179-44f2-a11a-53942fcb0148', '27fd2421-eb3d-4403-b5f4-007d735a5f6d', '0140a59c-f135-4aba-a6ca-8019eb491383', '57840d51-e693-4e21-8072-cf762f894310'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:56 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.515s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-988161573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5896dc29-1b42-47e5-afd7-ec89496aed0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ca60de4f1a84d94baf109cd7e3798c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:56Z,use_quota=True,user_id='55b46c4a7ba14a9c97023b6d654a81ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Creating volume 5896dc29-1b42-47e5-afd7-ec89496aed0a {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:56 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f9aa9d-ea97-4ce6-8c20-98a8936973db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (946bb1e0-63ee-4b06-9fce-1bdd272451c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a 1073741824 Apr 15 10:15:56 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:56 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Volume volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c (0fca32b8-bc2d-4fe2-a761-089a12fd886c): created successfully Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (946bb1e0-63ee-4b06-9fce-1bdd272451c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Flow 'volume_create_manager' (ed73ccff-17b2-41e3-a8af-579f34d6aa09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-094bf73f-6bd3-4746-aef7-74394aac4f3c tempest-CinderUnicodeTest-1571294884 None] Created volume successfully. Apr 15 10:15:56 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:15:56 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:56 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.510s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:56 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Deleted volume successfully. Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-58f4d3fd-51eb-464e-b474-255349326d40 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-b355ee0e-fa24-4ee4-a3e8-08f642e2cd9b-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:57 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a 1073741824" returned: 0 in 0.607s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:57 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a Apr 15 10:15:57 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-df84208a-aee7-4189-af53-9d521edc2f68-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-df84208a-aee7-4189-af53-9d521edc2f68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-quobyte-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Flow 'volume_create_manager' (3522aab9-aeb6-4fba-9bfb-60a0df05177b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a20008-9677-4770-b27c-54967ffd693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-quobyte-df84208a-aee7-4189-af53-9d521edc2f68" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a20008-9677-4770-b27c-54967ffd693b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1602457183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='767d17a07d50447db183545110196fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:57Z,use_quota=True,user_id='7169ffe62ebe4443a105a838cbc82dc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ddd8b0-d7aa-40d8-9304-735376c1da4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ddd8b0-d7aa-40d8-9304-735376c1da4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95630e63-4afd-4f16-ab3f-625e1d570485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95630e63-4afd-4f16-ab3f-625e1d570485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1', 'volume_name': 'volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e62dca-41d5-4f01-aa86-466ace25d0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e62dca-41d5-4f01-aa86-466ace25d0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44e9900-ad29-4e0f-9d2b-e5878238eb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:57 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Volume dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1', 'volume_size': 1} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-df84208a-aee7-4189-af53-9d521edc2f68" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Deleting offline snapshot df84208a-aee7-4189-af53-9d521edc2f68 of volume f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] snapshot_file for this snap is: volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eac8863-5aff-4f86-92c4-70c817abfca6]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:57 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 Apr 15 10:15:57 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:57 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a" returned: 0 in 0.483s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.416s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] Creating offline snapshot aba28ba6-03c7-41dc-8649-eb97c33341ca of volume 0fca32b8-bc2d-4fe2-a761-089a12fd886c {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cab595a-36fc-42f0-b119-a17a63e880da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5896dc29-1b42-47e5-afd7-ec89496aed0a', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b399540-d343-4818-bd32-38511fed5887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[896e7075-78b4-49c1-9dfb-f31c47894b48]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:57 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Volume volume-5896dc29-1b42-47e5-afd7-ec89496aed0a (5896dc29-1b42-47e5-afd7-ec89496aed0a): created successfully Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b399540-d343-4818-bd32-38511fed5887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Flow 'volume_create_manager' (c1e8b70d-835e-4ee6-b756-97cea5810fc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-716a04e5-061b-442d-bd43-2f3fc3be8d9d tempest-VolumeDependencyTests-1062553553 None] Created volume successfully. Apr 15 10:15:57 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c Apr 15 10:15:57 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:57 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68" returned: 0 in 0.456s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea00701-0c60-42de-8a77-d52a591c647b]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:57 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 Apr 15 10:15:57 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:58 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c" returned: 0 in 0.593s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:58 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca 1G Apr 15 10:15:58 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Flow 'volume_create_manager' (4f3c30d5-17f5-47bf-a5b6-217982b0fdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48d4399-b661-4ec8-8b66-0156d5680f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:58 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48d4399-b661-4ec8-8b66-0156d5680f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1252676422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37ed6bb-485a-4b4c-94fb-e058a8dde42d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ca60de4f1a84d94baf109cd7e3798c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5896dc29-1b42-47e5-afd7-ec89496aed0a,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:58Z,use_quota=True,user_id='55b46c4a7ba14a9c97023b6d654a81ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe6655e-ec10-4ed0-afdc-688fdb5c26b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe6655e-ec10-4ed0-afdc-688fdb5c26b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443d4d0b-0fa2-4ae8-8e61-774895aa822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6" returned: 0 in 0.521s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:58 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 Apr 15 10:15:58 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443d4d0b-0fa2-4ae8-8e61-774895aa822c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f37ed6bb-485a-4b4c-94fb-e058a8dde42d', 'volume_name': 'volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d', 'volume_size': 1, 'source_volid': '5896dc29-1b42-47e5-afd7-ec89496aed0a', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2f7fa8-8a0f-4e99-84be-4439c25d2496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2f7fa8-8a0f-4e99-84be-4439c25d2496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f04386-704c-4dc8-b8ff-14b44c6dd418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:58 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Volume f37ed6bb-485a-4b4c-94fb-e058a8dde42d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d', 'volume_size': 1, 'source_volid': '5896dc29-1b42-47e5-afd7-ec89496aed0a', 'source_volstatus': 'available'} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:58 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca 1G" returned: 0 in 0.498s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:58 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca Apr 15 10:15:58 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:58 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68" returned: 0 in 0.454s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:58 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68 Apr 15 10:15:58 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:59 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca" returned: 0 in 0.411s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:59 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca is being set with open permissions: ugo+rw Apr 15 10:15:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:59 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca Apr 15 10:15:59 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:59 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6.df84208a-aee7-4189-af53-9d521edc2f68" returned: 0 in 0.460s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-df84208a-aee7-4189-af53-9d521edc2f68" released by "_delete_snapshot" :: held 1.957s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6" released by "delete_snapshot" :: held 2.002s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:59 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Created reservations ['b7bcdeeb-6b20-471b-8cf4-6d79e61ab6fd', '805d848b-4683-46e4-8a55-3f3f7c9cb33d', '33e6553f-5a63-4fd5-81f7-8ceb39d8df9d', '4e1817c3-87c8-43c3-a4a9-966064a9193d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Delete snapshot completed successfully. Apr 15 10:15:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24dad471-cceb-4d8f-bbed-122c597cfccd tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-df84208a-aee7-4189-af53-9d521edc2f68-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:59 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca" returned: 0 in 0.429s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:59 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.info Apr 15 10:15:59 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:59 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.info" returned: 0 in 0.395s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:59 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.info is being set with open permissions: ugo+rw Apr 15 10:15:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:59 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.info Apr 15 10:15:59 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:00 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.info" returned: 0 in 0.413s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.805s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.103s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1602457183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='767d17a07d50447db183545110196fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:57Z,use_quota=True,user_id='7169ffe62ebe4443a105a838cbc82dc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Creating volume dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:00 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] casted to osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:00 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 1073741824 Apr 15 10:16:00 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:00 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7bc3e6d8-4631-41d7-a259-c3b9f471cf92 tempest-CinderUnicodeTest-1571294884 None] Create snapshot completed successfully Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "cinder-quobyte-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bc5575-3670-4613-bfe0-27c74d81b549]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:00 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 Apr 15 10:16:00 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:00 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 1073741824" returned: 0 in 0.489s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:00 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 Apr 15 10:16:00 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:00 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6" returned: 0 in 0.488s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:00 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6 Apr 15 10:16:00 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:01 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1" returned: 0 in 0.442s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.997s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:01 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Cloning volume 5896dc29-1b42-47e5-afd7-ec89496aed0a to volume f37ed6bb-485a-4b4c-94fb-e058a8dde42d Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "cinder-aba28ba6-03c7-41dc-8649-eb97c33341ca-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44e9900-ad29-4e0f-9d2b-e5878238eb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d9398e-cedf-4433-a3bb-915c108efd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-aba28ba6-03c7-41dc-8649-eb97c33341ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "cinder-quobyte-0fca32b8-bc2d-4fe2-a761-089a12fd886c" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:01 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Volume volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 (dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1): created successfully Apr 15 10:16:01 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d9398e-cedf-4433-a3bb-915c108efd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Flow 'volume_create_manager' (3522aab9-aeb6-4fba-9bfb-60a0df05177b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6" returned: 0 in 0.485s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Creating offline snapshot 0b254a46-f18b-49ad-bca6-7c0c07371ad3 of volume 5896dc29-1b42-47e5-afd7-ec89496aed0a {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-quobyte-0fca32b8-bc2d-4fe2-a761-089a12fd886c" acquired by "delete_snapshot" :: waited 0.050s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "cinder-quobyte-aba28ba6-03c7-41dc-8649-eb97c33341ca" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da7cd8f-9fdc-4ad5-9a14-7ed9d90a178f]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c5585780-3bae-4ced-adfc-ae61f5583f93 tempest-SnapshotDependencyTests-187495419 None] Created volume successfully. Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-quobyte-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6" released by "delete_volume" :: held 1.029s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-quobyte-aba28ba6-03c7-41dc-8649-eb97c33341ca" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Deleting offline snapshot aba28ba6-03c7-41dc-8649-eb97c33341ca of volume 0fca32b8-bc2d-4fe2-a761-089a12fd886c {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] snapshot_file for this snap is: volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c5795a-35ac-47bb-8010-f6355761908c]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:01 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a Apr 15 10:16:01 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Created reservations ['20d98b00-f9c1-492e-b89d-85b525896601', '4c5873c7-799a-4b42-ace3-3aa21bfe1b27', '1a88256d-5dc2-4870-9d7c-57600c2cf519', 'a3636b41-cf8a-4dd0-ac85-54487df7ff7b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:01 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca Apr 15 10:16:01 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:01 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:16:01 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:01 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a" returned: 0 in 0.466s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:01 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 1G Apr 15 10:16:01 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:01 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca" returned: 0 in 0.467s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:02 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[351e178f-fb0c-4b88-9e08-6802a0a0187b]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:02 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.439s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:02 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:02 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Deleted volume successfully. Apr 15 10:16:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4e686031-1bd3-4ffa-a9b4-bb1a5cef3f89 tempest-CreateVolumesFromSnapshotTest-1591415377 None] Lock "cinder-f5f3c5a5-b48a-424f-bcd9-0c1b9e64eba6-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:02 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c Apr 15 10:16:02 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:02 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 1G" returned: 0 in 0.502s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5896dc29-1b42-47e5-afd7-ec89496aed0a -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:02 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5896dc29-1b42-47e5-afd7-ec89496aed0a -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 Apr 15 10:16:02 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:02 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c" returned: 0 in 0.594s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:02 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca Apr 15 10:16:02 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:03 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5896dc29-1b42-47e5-afd7-ec89496aed0a -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3" returned: 0 in 0.628s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:03 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 is being set with open permissions: ugo+rw Apr 15 10:16:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:03 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 Apr 15 10:16:03 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:03 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca" returned: 0 in 0.572s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:03 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca Apr 15 10:16:03 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:03 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3" returned: 0 in 0.486s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:03 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.info Apr 15 10:16:03 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:03 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c.aba28ba6-03c7-41dc-8649-eb97c33341ca" returned: 0 in 0.500s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-quobyte-aba28ba6-03c7-41dc-8649-eb97c33341ca" released by "_delete_snapshot" :: held 2.218s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-quobyte-0fca32b8-bc2d-4fe2-a761-089a12fd886c" released by "delete_snapshot" :: held 2.257s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:03 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Created reservations ['5fe00e0b-1c47-4418-b5ef-96aae26ab5ca', 'cbf44f8d-1e65-450f-a15e-8d8b3fbb6b63', 'b64b32f5-bbce-4585-bd95-ca5f49f2cf53', 'ec9458b3-409f-4917-8b7e-fc8480f8608b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:03 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Delete snapshot completed successfully. Apr 15 10:16:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-79beeaf8-0a1c-4a20-a1ab-64972becaba7 tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-aba28ba6-03c7-41dc-8649-eb97c33341ca-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:03 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.info" returned: 0 in 0.429s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:03 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.info is being set with open permissions: ugo+rw Apr 15 10:16:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:03 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.info Apr 15 10:16:03 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:04 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.info" returned: 0 in 0.403s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-quobyte-f37ed6bb-485a-4b4c-94fb-e058a8dde42d" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-f37ed6bb-485a-4b4c-94fb-e058a8dde42d" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] snapshot: 0b254a46-f18b-49ad-bca6-7c0c07371ad3, volume: f37ed6bb-485a-4b4c-94fb-e058a8dde42d, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e82b501-f00b-45e7-b87e-15dfc8f85789]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:04 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 Apr 15 10:16:04 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "cinder-0fca32b8-bc2d-4fe2-a761-089a12fd886c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-0fca32b8-bc2d-4fe2-a761-089a12fd886c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "cinder-quobyte-0fca32b8-bc2d-4fe2-a761-089a12fd886c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-quobyte-0fca32b8-bc2d-4fe2-a761-089a12fd886c" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac355e75-803a-4a52-b317-a03c6c5a6ed9]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:04 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c Apr 15 10:16:04 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:04 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3" returned: 0 in 0.493s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5896dc29-1b42-47e5-afd7-ec89496aed0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] will copy from snapshot at /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b16dac-8259-46d3-b0fa-b7eea4ce9b8d]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:04 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a Apr 15 10:16:04 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:05 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c" returned: 0 in 0.492s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:05 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c Apr 15 10:16:05 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:05 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a" returned: 0 in 0.481s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Path /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:05 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d Apr 15 10:16:05 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:05 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-0fca32b8-bc2d-4fe2-a761-089a12fd886c" returned: 0 in 0.395s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-quobyte-0fca32b8-bc2d-4fe2-a761-089a12fd886c" released by "delete_volume" :: held 0.915s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Created reservations ['5aadaff5-8130-4f58-b8cd-69d1b2ce81c6', '525b0d34-0bf9-43ad-a953-0fb11b3047af', 'bbf78db7-1101-4b3e-a38b-e10fe73e0a82', '2fccc52a-3525-4a2e-8e7e-1c308fa41f4a'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:05 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:16:05 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "cinder-6e8e7b0e-fe64-4116-bc75-430bef5b97b4-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-6e8e7b0e-fe64-4116-bc75-430bef5b97b4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "cinder-quobyte-6e8e7b0e-fe64-4116-bc75-430bef5b97b4" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-quobyte-6e8e7b0e-fe64-4116-bc75-430bef5b97b4" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f55fed5-d897-494c-98c1-292137a9ed14]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:05 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4 Apr 15 10:16:05 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:06 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 1.015s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:06 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Deleted volume successfully. Apr 15 10:16:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4dec8d91-a83c-48c3-ac4f-dd27966814d1 tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-0fca32b8-bc2d-4fe2-a761-089a12fd886c-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:07 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4" returned: 0 in 1.493s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:07 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4 Apr 15 10:16:07 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:07 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d" returned: 0 in 2.198s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c24e9e-c049-4cbd-8ced-128a0d606eae]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:07 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a Apr 15 10:16:07 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:07 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-6e8e7b0e-fe64-4116-bc75-430bef5b97b4" returned: 0 in 0.619s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-quobyte-6e8e7b0e-fe64-4116-bc75-430bef5b97b4" released by "delete_volume" :: held 2.134s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Created reservations ['98c4cc2d-7393-4566-918b-1f2b0c8653fe', '3b3c1ff8-a94c-44b8-bbe7-42bd3e7cb48d', 'a3e4fe1a-f565-43e6-b775-3d9155b016e8', 'e995c097-2656-46f2-a8bf-f6ecf5818350'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:07 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:16:07 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:08 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a" returned: 0 in 0.592s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a, size 1024.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:16:08 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Converted 1024.00 MB image at 465.55 MB/s Apr 15 10:16:08 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d is being set with open permissions: ugo+rw Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:08 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d Apr 15 10:16:08 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:08 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.403s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Deleted volume successfully. Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-57fa6e6e-9b41-43f2-af37-347949a48b0c tempest-CinderUnicodeTest-1571294884 None] Lock "cinder-6e8e7b0e-fe64-4116-bc75-430bef5b97b4-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:08 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d" returned: 0 in 0.403s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-f37ed6bb-485a-4b4c-94fb-e058a8dde42d" released by "_copy_volume_from_snapshot" :: held 4.209s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-quobyte-0b254a46-f18b-49ad-bca6-7c0c07371ad3" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-0b254a46-f18b-49ad-bca6-7c0c07371ad3" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Deleting offline snapshot 0b254a46-f18b-49ad-bca6-7c0c07371ad3 of volume 5896dc29-1b42-47e5-afd7-ec89496aed0a {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] snapshot_file for this snap is: volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a918ec73-eab9-4409-a0fe-7064b7db274b]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:08 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 Apr 15 10:16:08 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:09 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3" returned: 0 in 0.495s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5896dc29-1b42-47e5-afd7-ec89496aed0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:09 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2445bd62-9af3-4124-b481-292466251fd6]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:09 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a Apr 15 10:16:09 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:09 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a" returned: 0 in 0.556s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:09 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 Apr 15 10:16:09 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:10 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3" returned: 0 in 0.508s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:10 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3 Apr 15 10:16:10 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:10 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a.0b254a46-f18b-49ad-bca6-7c0c07371ad3" returned: 0 in 0.405s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-0b254a46-f18b-49ad-bca6-7c0c07371ad3" released by "_delete_snapshot" :: held 2.013s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.331s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.868s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f04386-704c-4dc8-b8ff-14b44c6dd418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d', 'volume_size': 1, 'source_volid': '5896dc29-1b42-47e5-afd7-ec89496aed0a', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b2421d-8146-443b-978e-fc76c70de72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] Creating offline snapshot c69290e8-0990-466d-a559-1da17f9e3980 of volume dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:16:10 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Volume volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d (f37ed6bb-485a-4b4c-94fb-e058a8dde42d): created successfully Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b2421d-8146-443b-978e-fc76c70de72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Flow 'volume_create_manager' (4f3c30d5-17f5-47bf-a5b6-217982b0fdfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c78c8ad-c991-4c4f-bcd0-1b081921ab71]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:10 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8c1520b4-55bb-4f7b-af38-63c64ad2019d tempest-VolumeDependencyTests-1062553553 None] Created volume successfully. Apr 15 10:16:10 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 Apr 15 10:16:10 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-5896dc29-1b42-47e5-afd7-ec89496aed0a-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-5896dc29-1b42-47e5-afd7-ec89496aed0a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-quobyte-5896dc29-1b42-47e5-afd7-ec89496aed0a" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-5896dc29-1b42-47e5-afd7-ec89496aed0a" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:11 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd0fe05-28b4-45b8-9b24-13e79ebfb784]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:11 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a Apr 15 10:16:11 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:11 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1" returned: 0 in 0.517s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:11 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 1G Apr 15 10:16:11 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:11 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a" returned: 0 in 0.492s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:11 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a Apr 15 10:16:11 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:11 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 1G" returned: 0 in 0.487s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:11 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 Apr 15 10:16:11 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:11 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-5896dc29-1b42-47e5-afd7-ec89496aed0a" returned: 0 in 0.416s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-5896dc29-1b42-47e5-afd7-ec89496aed0a" released by "delete_volume" :: held 0.951s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Created reservations ['865105ac-d190-4f45-b370-e434b9a022b7', 'bdd05d45-fd49-459f-92b5-1a6550e5eca5', '173fc7c0-af59-489c-b3a6-10c3dc8e9643', 'accf9ecd-d185-4456-81be-e78d5fe2a4d3'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:12 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:16:12 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-f37ed6bb-485a-4b4c-94fb-e058a8dde42d-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-f37ed6bb-485a-4b4c-94fb-e058a8dde42d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-quobyte-f37ed6bb-485a-4b4c-94fb-e058a8dde42d" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-f37ed6bb-485a-4b4c-94fb-e058a8dde42d" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:12 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 -F qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980" returned: 0 in 0.477s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:12 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 is being set with open permissions: ugo+rw Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[866ab62e-2121-4ea4-a4ae-7ee9f95c1351]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:12 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 Apr 15 10:16:12 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:12 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d Apr 15 10:16:12 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:12 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.451s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:12 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Deleted volume successfully. Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3db56e22-a0ac-4458-9f64-9633a634322d tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-5896dc29-1b42-47e5-afd7-ec89496aed0a-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:12 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980" returned: 0 in 0.434s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:12 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.info Apr 15 10:16:12 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:12 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d" returned: 0 in 0.494s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:12 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d Apr 15 10:16:12 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:13 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.info" returned: 0 in 0.404s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:13 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.info is being set with open permissions: ugo+rw Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:13 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.info Apr 15 10:16:13 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:13 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-f37ed6bb-485a-4b4c-94fb-e058a8dde42d" returned: 0 in 0.426s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-f37ed6bb-485a-4b4c-94fb-e058a8dde42d" released by "delete_volume" :: held 0.947s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Created reservations ['35c806c7-7b91-4273-9c4b-29e037a30165', 'fa044921-e8ce-4c98-a86f-0667202737f4', 'a7e5ec99-710a-4696-89ed-a82b8abeb1f2', 'f6b9ee35-6b8b-49b1-9b33-5009002d3a07'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:13 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:16:13 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "cinder-quobyte-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c109fe2b-6831-4870-8eab-53984c51c9ff]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:13 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5 Apr 15 10:16:13 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:13 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.info" returned: 0 in 0.485s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.878s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:13 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d26edcc2-2998-425a-b47e-021c34c3bae8 tempest-SnapshotDependencyTests-187495419 None] Create snapshot completed successfully Apr 15 10:16:13 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.451s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:13 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Deleted volume successfully. Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4316e240-3cbd-4e9f-ad80-2d0d13908673 tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-f37ed6bb-485a-4b4c-94fb-e058a8dde42d-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:13 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5" returned: 0 in 0.491s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:13 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5 Apr 15 10:16:13 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:14 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5" returned: 0 in 0.424s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-quobyte-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5" released by "delete_volume" :: held 0.947s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Created reservations ['9427e80b-84cb-4c74-9360-41af6a6a911e', 'b5e4983d-b96e-4215-b7ef-53dfea59d1e8', '349c90a3-5e96-4d32-a123-bfcaabd47503', 'd091c1e6-e687-442e-ae8b-71674e878a7f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:14 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:16:14 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Flow 'volume_create_manager' (8276270f-6c63-4659-9187-2bd028ac477c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95807e7a-04dd-4610-b0e3-76247c3df942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95807e7a-04dd-4610-b0e3-76247c3df942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d09812-4b9f-43e7-88c2-bf85b347dde6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='767d17a07d50447db183545110196fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c69290e8-0990-466d-a559-1da17f9e3980,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:15Z,use_quota=True,user_id='7169ffe62ebe4443a105a838cbc82dc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f),volume_type_id=1417a0eb-5acb-4f01-bbe2-dc8f3c18ca8f)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1760642d-6dc9-49ea-8efb-5db5816729d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1760642d-6dc9-49ea-8efb-5db5816729d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2fb5a2-9113-42cb-be16-29643c2abbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2fb5a2-9113-42cb-be16-29643c2abbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '82d09812-4b9f-43e7-88c2-bf85b347dde6', 'volume_name': 'volume-82d09812-4b9f-43e7-88c2-bf85b347dde6', 'volume_size': 1, 'snapshot_id': 'c69290e8-0990-466d-a559-1da17f9e3980'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987dd6ff-e5f4-42e3-ac7f-f69364b8c53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987dd6ff-e5f4-42e3-ac7f-f69364b8c53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc494b1-38f4-4e63-9426-ea6f849cfe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:14 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Volume 82d09812-4b9f-43e7-88c2-bf85b347dde6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-82d09812-4b9f-43e7-88c2-bf85b347dde6', 'volume_size': 1, 'snapshot_id': 'c69290e8-0990-466d-a559-1da17f9e3980'} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "cinder-quobyte-c69290e8-0990-466d-a559-1da17f9e3980-82d09812-4b9f-43e7-88c2-bf85b347dde6" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-quobyte-c69290e8-0990-466d-a559-1da17f9e3980-82d09812-4b9f-43e7-88c2-bf85b347dde6" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Creating volume 82d09812-4b9f-43e7-88c2-bf85b347dde6 from snapshot c69290e8-0990-466d-a559-1da17f9e3980 {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Selected osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "cinder-quobyte-82d09812-4b9f-43e7-88c2-bf85b347dde6" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-quobyte-82d09812-4b9f-43e7-88c2-bf85b347dde6" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] snapshot: c69290e8-0990-466d-a559-1da17f9e3980, volume: 82d09812-4b9f-43e7-88c2-bf85b347dde6, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8d1c7b-c467-4209-8979-103cca37edc7]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:14 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 Apr 15 10:16:14 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:15 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.486s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:15 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Deleted volume successfully. Apr 15 10:16:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98a9f7d6-f7cc-4bf8-8ff7-d0857abefd9f tempest-VolumeDependencyTests-1062553553 None] Lock "cinder-e15cec92-bd8d-4d0f-aaca-2b2ee40a9ed5-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:15 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980" returned: 0 in 0.481s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] will copy from snapshot at /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:16:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:16:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e202e589-9b19-4402-962d-ca0b29f41678]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:15 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 Apr 15 10:16:15 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:15 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1" returned: 0 in 0.539s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:15 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Path /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:16:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:15 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6 Apr 15 10:16:15 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:18 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6" returned: 0 in 2.239s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[710da6fc-b63c-4287-a056-8057735059ae]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:18 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 Apr 15 10:16:18 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:18 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1" returned: 0 in 0.570s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:18 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Image conversion details: src /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:16:18 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Converted 1024.00 MB image at 457.13 MB/s Apr 15 10:16:18 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6 is being set with open permissions: ugo+rw Apr 15 10:16:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:18 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6 Apr 15 10:16:18 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:19 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6" returned: 0 in 0.409s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-quobyte-82d09812-4b9f-43e7-88c2-bf85b347dde6" released by "_copy_volume_from_snapshot" :: held 4.287s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-quobyte-c69290e8-0990-466d-a559-1da17f9e3980-82d09812-4b9f-43e7-88c2-bf85b347dde6" released by "_create_volume_from_snapshot" :: held 4.312s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.320s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:19 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=200,cinder:UPDATE=286,cinder:DELETE=23,cinder:INSERT=54 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:16:19 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=274,cinder:SELECT=199,cinder:INSERT=79,cinder:DELETE=28 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:16:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc494b1-38f4-4e63-9426-ea6f849cfe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d09812-4b9f-43e7-88c2-bf85b347dde6', 'volume_size': 1, 'snapshot_id': 'c69290e8-0990-466d-a559-1da17f9e3980'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d23b769-63c5-475d-bd02-0d4b5f0cab01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:19 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Volume volume-82d09812-4b9f-43e7-88c2-bf85b347dde6 (82d09812-4b9f-43e7-88c2-bf85b347dde6): created successfully Apr 15 10:16:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d23b769-63c5-475d-bd02-0d4b5f0cab01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Flow 'volume_create_manager' (8276270f-6c63-4659-9187-2bd028ac477c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-231841b8-e357-4da4-b4d8-bb2f9f32a130 tempest-SnapshotDependencyTests-187495419 None] Created volume successfully. Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "cinder-c69290e8-0990-466d-a559-1da17f9e3980-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-c69290e8-0990-466d-a559-1da17f9e3980-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "cinder-quobyte-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-quobyte-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "cinder-quobyte-c69290e8-0990-466d-a559-1da17f9e3980" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-quobyte-c69290e8-0990-466d-a559-1da17f9e3980" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Deleting offline snapshot c69290e8-0990-466d-a559-1da17f9e3980 of volume dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] snapshot_file for this snap is: volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab5b621-4b2e-46e2-9d6d-293c88c1e95e]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:20 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 Apr 15 10:16:20 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:20 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980" returned: 0 in 0.468s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bec459-838e-4154-b61c-ec8ed7000f8a]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:20 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 Apr 15 10:16:20 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:21 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1" returned: 0 in 0.455s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:21 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 Apr 15 10:16:21 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:21 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980" returned: 0 in 0.435s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:21 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980 Apr 15 10:16:21 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:22 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1.c69290e8-0990-466d-a559-1da17f9e3980" returned: 0 in 0.392s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-quobyte-c69290e8-0990-466d-a559-1da17f9e3980" released by "_delete_snapshot" :: held 1.807s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-quobyte-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1" released by "delete_snapshot" :: held 1.820s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:22 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Created reservations ['06c0c970-ba0a-401b-8e7f-89e175876241', '5d8b5b8f-0333-47fc-9a72-d1aa72af626e', 'b74fb9c7-6a77-49f0-88bd-77b54c9ec9fa', 'dd9180c3-220d-4db9-b296-235becfb3601'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Delete snapshot completed successfully. Apr 15 10:16:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9a39d163-7d32-4522-9058-933297010cac tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-c69290e8-0990-466d-a559-1da17f9e3980-delete_snapshot" released by "delete_snapshot" :: held 1.896s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "cinder-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "cinder-quobyte-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-quobyte-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:22 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04da435-a89f-4714-870b-3e46a3a4dcbd]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:22 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 Apr 15 10:16:22 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:22 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1" returned: 0 in 0.451s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:22 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1 Apr 15 10:16:22 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:23 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1" returned: 0 in 0.379s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-quobyte-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1" released by "delete_volume" :: held 0.861s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Created reservations ['f021fb0a-1cd4-4ae4-90c7-1326ef0e4dff', '64991d31-5497-4736-9c04-d1e2ce6a8043', '1fc5f62d-a926-4177-87c0-3a2578936181', '1a26ef56-2e4c-4d5b-8b94-b727c2bfe83a'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:23 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:16:23 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "cinder-82d09812-4b9f-43e7-88c2-bf85b347dde6-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-82d09812-4b9f-43e7-88c2-bf85b347dde6-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "cinder-quobyte-82d09812-4b9f-43e7-88c2-bf85b347dde6" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-quobyte-82d09812-4b9f-43e7-88c2-bf85b347dde6" acquired by "delete_volume" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[301e83f6-2c82-4aa1-be5d-c65b6a72149c]: (4, 'qcow2') {{(pid=83946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:23 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6 Apr 15 10:16:23 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:23 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.418s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Deleted volume successfully. Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6d57fca2-97cf-4cb0-9d2a-ecfa72e4809a tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-dce2fe6f-cab0-47a9-8262-cc4cf43aa2f1-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:23 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6" returned: 0 in 0.467s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:23 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6 Apr 15 10:16:23 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:24 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3/volume-82d09812-4b9f-43e7-88c2-bf85b347dde6" returned: 0 in 0.381s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:24 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-quobyte-82d09812-4b9f-43e7-88c2-bf85b347dde6" released by "delete_volume" :: held 0.870s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:24 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Created reservations ['31b637af-ead9-422c-b5c5-59e63d72a969', 'e80ee790-1b72-4a00-a918-9f66727722dc', '71694846-e4c2-45df-a066-1da852d524a6', 'ef5da27f-7266-4003-9439-65d7714577b7'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:24 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:16:24 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:24 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.437s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:24 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Deleted volume successfully. Apr 15 10:16:24 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-29081fc0-f34f-4798-8d8e-50a8fc40adc8 tempest-SnapshotDependencyTests-187495419 None] Lock "cinder-82d09812-4b9f-43e7-88c2-bf85b347dde6-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:34 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=19,cinder:SELECT=17,cinder:INSERT=9,cinder:DELETE=1 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:16:34 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:DELETE=2,cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=26 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:16:37 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:16:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d366339e-d785-49b8-a450-10cfe24cfe2b'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:37 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3 Apr 15 10:16:37 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:38 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/172253d562f1ba46b01e5aa5ec9e2ee3" returned: 0 in 0.394s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:38 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6f89dbf1-0063-436e-a033-05d3ddad06dc None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}